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ABSTRACT 



This report describes the fifth in a series of investigations of the 
nature^ role and quality of teacher-developed classroom assessments* The 
purpose of this research program is to provide a clear picture of the 
assectsment denan^s of the classroom so teacher educators can plan assessment 
training that is relevant to teachers' needs* The purpose of this particular 
study in the series was to develop instrumentation for the observation and 
description of Individual teachers* classrocm assessment environments* Once 
developed^ such instrumentation will serve as a valuable classroom observation 
and feedback tool and a useful research tool for coi^paring environments across 
grades and subjects* 

Beginning with a general observational framework from a previous study^ 
four researchers observed and described two classroom assessment environments 
each* Classrooms studied included high school mathanaticsr science^ language 
arts and social studies contexts* After coiopleting observations and 
interview with teachers and students r researchers revised the framework and 
the researchers prepared a profile of each classroom assessment environctent 
they studied* Those profiles are presented herein* Each escplores the 
teacher's reasons for assessment^ the assessment i»&thodology used^ the factors 
considered by the teacher in selecting those oethodsr the quality of 
assessments^ the teacher's use of feedbacks the teacber*s perceptions of 
students r and the effect of policy on classroom assessment* 

Based On a synthesis of profiles^ generalizations are drawn about (a) the 
nature^ role and quality of classroom assessment and (b) teacher and principal 
assessment training needs* 
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CHAPTER It RESEARCH OVERVIEW 



In recent yearsr the »orth%«e8t Begionai Educational Laboratory's Center 
for Perforatance Assessnent has been conducting an ongoing program of research 
on the nature^ role and quality of classroom assessment* The focal point of 
this research is the assessment procedures teachers develop and use on a day 
to day basis to measure the achiev^ent and affective characteristics of 
students* The research reported here represents the fifth study in this 
research program and the second dealing with the goal of developing the 
instrumentation needed to profile the characteristics of teachers* classroom 
assessment environments* The entire series of studies is reviewed below in 
order to set the context for the investigation reported herein* 

The rationale for this program of research .^s described in great depth and 
detail elsewhere (Stiggins^ 1985 and Stiggins^ Conklin & Bridgeford^ 1386) and 
therefore is not recounted here* Suffice it to say that the measurement 
research conmunity has long neglected the studty of classroom assessment in 
favor of research on tcqpics relevant to large-scale^ standardized testing 
programs* Consequently^ the assessment training offered to teachers has 
consistently reflected naive perspectives regarding the task demands of the 
classroom* The training has often been seen by teachers as irrelevant and 
insensitive to their needs* As a result^ such training often is not required 
as part of either teacher or administrator professional preparation programs* 
Therefore^ teachers can ^pend as much as a quarter to a third of their 
instructional time involved in assessment activities which^ by their own 
admission^ they are not trained to handle* Furthermorer these activities are 
carried out in a context supervised by a principal who has no more assessment 
training than the teacher* 

The purpose of this research is to provide the depth of understanding 
needed to plan relevant^ useful classroom assessment training for teachers and 
administrators* In sbort^ the research is based on the proposition that 
effective instruction is only possible if it is based on the sound assessment 
of student characteristics* Sound assessment is only possible with high 
quali^ teacher and administrator training in assessment* Sound training ^ in 
turnr is only possible with a clear understanding of the task demands of 
classroom assessment* 



Overview of the Research Program 

nie first stuiSty in the sequence^ conducted in 1982^ was designed to 
provide a very general picture of classroom assessment from the teacher's 
point of view* Teachers' percei>tions were gathered via small group 
discussions structured around assessment issues* Stwjty two^ completed in 
19d3r was intended to add detail to the picture* Using the results of study 
oner researchers devised a protocol for one<-on-one structured interviews of 
over 100 teachers regarding their classroom assessment methods* The results 
of Btu^ two provided sufficient focus to the research questions to permit the 
development of the comprehensive questionnaire needed for a broad sampling of 
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classroom assessment practices* This Instrument served as the basis for study 
three I which probed the practices of a stratified sangf^le of teachers across 
the nation and provided a high resolution portrait of classroom assessments as 
described by the teachers who carry it out (Stiggins & Bridgefordr 1965)* 

niis sequence of three studies contributed significantly to our 
understanding o£ the assessment demands of the classroom* As a results we 
were able to devise new training materials that helped teachers meet seme of 
those danands* Exanqples include training guides ont 

Classroom Applications of Writing Aasesament (by vicki spandel^ 1982^ 
published in 1984 by IWItEL; reprinted in 1985) r 

Evaluating students by Classroom Observation (by Richard StigginSf 1984, 
published by NBA and revised for republication in 1986) r and 

Measuring Thinking Skills in the Classroom (by Richard Stiggins^ 
Evelyn Rubel & Edys Quellmal2r published in 1986 by NBA) 



However^ as productive as these three studies werer they shared one common 
shortcoming which tended to constrain the depth of understanding provided by 
each* Essentially^ they reported what teachers said they did in classroom 
assessment* But we were unable to discern if discrepancies existed between 
teacher self*reports and actual classroom practices* The only viable research 
strategy for describing actual classroom assessment practices was the 
observation of those practices as they were carried out in the classroom* 
Therefore^ survey research methods were replaced by ethnographic (participant 
observer) methods for studies four and five* 

In study fOur (stigginsr Conklinr Bridgeford & Brody, 1985) r two data 
collection methods were used* In the firsts three researchers became teachers 
aides in 6th grade classrooms* Using a very general set of guiding issues^ 
they observed and recorded assessment events as they unfolded, interacting as 
needed with teacher and students to understand how events were perceived* In 
addition^ thir^^two teachers from a variety of grade levels were asked to 
keep journals in which they described key assessment events over a 10-week 
period* Insults of the observation and journal analyses were synthesized to 
produce the initial version of a profile of a classroom assessment 
environi!ient~an instrument which would allow researchers to efficiently map 
the key characteristics of an environment* This profiling instrument served 
as the basis of study fiver which is the focus of this report* 



Study Five Methodology 

The goal of etu^ five was to use the profiling instrument (which was 
devised at the junior high level) to map assessment environments at the hi9h 
school level in order to (a) explore the efficiency and applicability of the 
instrument in the new context and (b) discover its sensitivity to differences 
in assessment environments* He sought to evaluate and refine the profiling 
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instrument because it has the potential of (a) providing teachers with precise 
feedback on strengths and weaknesses in their assessment environments^ and (b) 
serving as a valuable research tool for the further investigation of 
assessment environments across grade levels and subjects* In either caser 
such instrumentation would provide a powerful microscope to use in planning 
relevant teacher training in assessment* 

Teachers Studied . A total of 8 high school teachers were stiudied* All 
were recoimiiended for the study by their principal and each agreed to 
participate* Thusr in effects all teachers v. *^e volunteers* Of the total, 
two teachers were chosen from four subject matter areast mathr science^ 
social studies and language arts* £ach was a veteran teacher r teaching a 
range of content in their fields from remedial or beginning courses to 
advanced courses* 

Profile Elements* fiased on the results of study fourr researchers 
conducted study five case studies with the intent of profiling the assessment 
environments according to the following framework* 
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FACTOfiS INFLUEHCIHG THE 
CLASSROOM ASSESSMENT EHVIBOMMENT 



Factor 

1* Teacher Characteristics 

A* Knowledge of assessment methodology 

( 1) Paper and pencil test development 

( 2) Paper and pencil test use 

( 3) Performance assessnent development 

( 4) Performance assessment use 

( 5} Oral questioning strategies 

( 6) Test analysis strategies 

( 7} ^st score interpretations and use 

( 8) Grading strategies 

( 9} Assessing thinking skills 

B* Classroom Experience 

( 1} In district 
( 2} In school 
( 3) At grade level 
( 4) With content 

C* Personal Characteristics of Teacher 

( 1} Perceived autonomy 
in classroom 

( 2) Expectations of professional self 

( 3) Orientation to classroom structure 
( 4} Definition of high quality 

performance 
( 5} Attention to exceptional student 
( 6) Sense of student norms 
( 7} Willingness to experiment with 

class 

( 8) Willingness to experiment with 

student 
( 9) Orientation to class 

(10) Expectations of v«orking 
relaticxiships 

(11) Attributions of success/ 
failure of students 

(12) Orientation to punctuality 

(13) Definition of '•on-task'* 



He levant 
Continuum 



ftell informed* 
uninformed 



Exper ienced- 
inexperienced 
(in years) 



Servant of parents/ 

schoolS'indeP^ndent 
professional 

Expect little- 
expect a lot 

Rigid-flexible . 

Righ t/wr ong -r ange 
of quality 

Never ^frequent 

Clear -unclear 

No risks-risk taker 

No risks-risk taker 

One on one'^roup 
Cooperation* 

c^petition 
Student responsible'' 

teacher responsible 
Demand it'HJnconcerned 



Data 
Collection 



Test (oral 
or written) 

Self report 
(discussion 
or interview) 

Observation of 
assessments 



Self report 



Interview 



Interview 

Interview 
Observation 

Observation 

Interview 

Interview 

Interview 

Observation 
Interview^ 

observation 
Interview 

Observation 
Interview 
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Factor 

Teacher's Perceptions of Current Class 



Relevant 
Continuum 



( 1) Ability to learn 

( 2) variation in ability 

( 3) Bate of achievement 



( 4) variation in rate 

( 5) Willingness to learn 

< 6) Variation in willingness 

( 7) Maturity 

( 8) Study skills 



( 9) Social skills 

(10) Willingness to perform 

(11) Gender differences 
<12) Feedback needs 



(13) Self-assessment skills 

(14) Student sense of what^s fair 

(15) Beactions to teeting 

(16) Parental expectations 



E* Valued reasons for assessment 

( 1) Diagnosing group needs 

( 2) Diagnosing individual needs 

( 3) Sizing students up in fall 

( 4) Selecting for special services 

( 5) Controlling students 

( 6) Motivating students 

( 7) Evaluating instruction 

( 8) Communicating academic expectations 

( 9} Coiimunicating behavioral expectations 

(10) As test taking training for students 



Data 
Collection 



Interview/ 
discussion 



Low-high 

Low-high f 
Accelerating- 
deceleration 
High-low 



Besponsible- 

irresponsible 
Developed *undeve loped 
Follov^ oirections- 

have difficulty with 

same 

Deve loped*unde veloped 

Cooperative*disruptive 

CCH^plaint-resistant 

Willing -reticent 

Passive-aggressive 

Impor tan t *un impor tan t 

Related interactions? Observation 

Frequent 'infrequent 

Individual-group 

Verbal-mode la 

Deve loped *undeve loped 

Clear -unclear 

Positive-negative 

Anxious- tranqui 1 

Clear*unclear 

High- low 



Important- 
unimportant 



Interview with 
anecdotes 
from 

observation 
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Relevant 

Factor Continuum 

F* Valued Assessment Methods 

( 1) Dally written assignments 

( 2) Observation and judgment 

( 3} Paper and pencil tests 

( 4) Assessments from text 

( 5) Assessments from other teachers 

( 6) Oral recitation in class 

( 7) Standardized tests 

( 8) Student peer assessment 

( 9) Student aelf assessment 

(10) Group assessments 

6« Valued strategies for Conmunicating Bxpec tat ions 



Data 
Collection 



Interv iew 



( 1) Written, verbal 

( 2) Oral 

( 3) Via model or example 

( 4) via assessments 

H« Strategies for Providing Feedback to 

( 1} Students 

(a) formality 

(b) mode 

(c) frequency 

(d) form 

(e) focus 



Useful-useless 



Interview 



Observation 



Formal'informal 

Written-oral 

Never -continuously 

Grades-comments 

Private-public 

Achievement? 

Ability? 

Social personal traits? 



( 2) Parents 

(a) formality 

(b) mode 

(c) frequency 

(d) form 

(e) focus 



Formal'^informal 

Written-oral 

Never *^ont in uously 

Grades-comments 

Private-public 

Achiev^ent? 

Ability? 

Social personal traits? 



( 3) Supervisors 

(a) formality 

(b) mode 

(c) frequency 

(d) form 

(e) focus 



Formal^informal 

Written-oral 

Never -cent inuously 

Grades-comments 

Private^ublic 

Achievement? 

Ability? 

Social personal traits? 
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Relevant 
Continuum 



Data 
Collection 



2* ClasETOOin Characteristics 

A* Staffing and Organization 

( 1) Teachers present 

( 2) Teacher aid 

( 3} Parental assistance 

( 4) Free planning pe]clods 

fi* Use of Space 

( 1} Density of students (sp^ce/student) 
( 2) Mysical arrangement 
( 3} Assessment displays 

(a) records of achiev^ent 

(b) models of good work 

( 4} Neatness and order criteria 
( 5) Strategies for noise control 
during assessment 

(a) specific rules 

(b) seating airarigements 

C. Support for Assessment 

( 1) Resource8 such as library* 

movies f etc* 
( 2} Equipment such as size lab 

( 3} Facilities such as computers 
and overflow space 



Observation 

Alone -team 
Available? 
Never-frequently 
Itone^-many 



Much* lit tie Observation 
Describe it*- 

Present? 

Explicit-implicit 
Fresent*absent 
Rigorously applied? 



Observation 

Available? 
Used? 

Available? 
Used? 
Available? 
Used? 



3* School and District Policy. 



A. Standardized Testing Policy 



( 1) Sense of accountability for scores 

( 2) Scores valued and used 

( 3) Time committed to testing 

( 4) Perceive importance of 
testing experience 

fi* Policy Begarding Becordkeeping and 

( 1} Frequency 



Overt policy- 
see policy 
manuals 

Covert policy- 
interview ad- 
ministrators 

Strong^weak 
Useful'useless 
(In hours) 

Impor tant-unimpor tant 



Reporting 

Frequent-infrequent 
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Factor 
( 2) Content 

( 3) EoriQ 

( 4) Target of reports 

C* Policy Regarding Eoinework 

( 1) Frequency 

( 2) Forn) of homework required 

( 3) Grading policy 

( 4) Time appropriation 

( 5) Bellance on text assignments 

D* Policy Itegarding Grouping for Special 
(L*D*r Glftedr Chapter 1^ etc*) 

( 1) Data requir€9nents 

( 2) Classrocn data allowed 

( 3) Criteria for selection 

K* Valued District Uses of Test Data 

( 1) ^ establish teacher accountability 
( 2) Ito compare schoolsr classes/ etc* 
( 3) To show achlevwent trends 

4* Characteristics of Texts and Materials 

A* Assessments Provided In Texts 
{may vary with subject) 



Relevant 
Continuum 

tehleveinent? 
Ability? 

Social personal traits? 

fitandard-lndlvldual 

Grades-comments 

Students? 

Parents? 

Supervisors? 



Intervals or 
frequency specified? 
Written only? 
% cutoffs? 
Specified? 
Required? 

Services 



Clear*unclear 
Gr ad es-conunen ts 
Clear*unclear 



Impor tan t *un impor tan t 



Data 
Collection 



Examine tests 
J< associated 
materials 



( 1) Discussion questions for class 

recitation 
( 2) Hcmework assignments in text 
( 3) Workbook study sheets 
{ 4) Assessment guidelines in 

teacher *s guide 
( 5) Paper and pencil tests 
( 6) ^rformance assessments 



Present~absence 
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Factor 



Relevant 
Continuum 



Data 
tollection 



E* Quality of Assessnients Offered 

( 1) validity 

{a} match content of text 

(b) match cognlt;lve levels of 
text and recitation 

(c) sample representatively? 
( 2) Reliability 

(a) length 

(b) methods 

(c) Item construction 

(d) scoring guidelines 
( 3) Ease of use 



Hlss^atch 



App r Qpr late*lnappr opr late 
Obj ect lve-*sub ject Ive 
Clear^unclear 
Absent^etalled 
Ccmvenlont-^lnconvenlent 



C* ikmtext Materials Csed In Assessment? (describe them) 

5. Characteristics of School Subject 

A. Perceived Unportar^ of Subject as Seen by 
(vlll vary by subjf^t) 



( 1) Students 

( 2) Parents 

( 3) Teachers 

( 4) School 

( 5) District 



Important-unimportant interview 



E* Other Indicators of Importance 
(by subject) 

C* Belatlonsblp of Oontent to Assessment 
Optlcms (by subject) 



Xlme allotted 
Requl red *<)pt lona 1 



Examine 
records 

Examine 
ccmtent 



( 1) Written assignments 

( 2) Teacher observation and judgment 

( 3) Clasaroon paper and pencil tests 

( 4) Assessments from texts 

( 5) Assessments from other teachers 

( 6) Oral recitation 

( 7) Self assessments 

( S) Peer aseessmftits 

( 9) Standardized tests 

(10) Group assessment 

(11) Appllcatlcm of rules of 
evidence 



Amenable to content- 
not amenable 



Punctual completion* 
quality 

High t/v r ong -deg r ee s 
of quality 
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Factor 

6* Characteristics of Assessments 



Relevant 
Continuion 



l>ata 
Collection 



A. 



{ 
{ 
( 
( 
{ 
( 
( 
( 
( 

(10) 



I) 
2} 
3) 
4} 
5) 
6) 
7) 
8) 
9) 



Assessment Purposes Demonstrated 
(may vary with subject) 

Diagnosing group needs 
Diagnosing individual needs 
Sizing students up in fall 
Selecting for special services 
Controlling students 
Motivating students 
Evaluating instruction 
Cowunicating acadanic expectations 
Ccsinnunicating behavioral expectations 
As test taking training for students 

Assessment Practices Used 
(may vary with subject) 



Observation 



Never used* 
fre^ently used 



enervation 



( 1) Daily written assignments 

( 2) Observation and judgment 

( 3) Paper and pencil tests 

( 4) Assessments from text 

( 5) Assessments from other teachers 

( 6} Oral recitation in class 

( 7) Standardized tests 

( 8} Student peer assessment 

( 9) Student Belf assessment 

(10) Group assessments 

C* Categories of Thinking Skills Addressed 



never used* 
frequently used 



Observation 



( 1) Levels defined 

( 2) Levels in assessment match 

instruction 
( 3) Describe levels used 



No-clear ly 
Hiss-match 



Criteria Used by Teacher in Selecting Method 



Interview 



( 1) Fit of results to purpose 

( 2) Hatch to material taught 

( 3) Ease of development (easy access) 

( 4) Base of scoring 

( 5) Origin of test 

( 6} Time required to administer 

( 7) Degree of objectivity 

( 8) Test security 



Impor tan t -unimpor tan t 
Evaluated how? 
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factor 

K* Quality of Assessments 



( 1) validity 

(a) match to content 

(b) match to cognitive levels 

(c) representative sample? 
( 2) Reliability 

(a) length 

(b) methods 

(c) item construction 

(d) scoring procedures 



Relevant 
Continuum 



Data 
Collection 

Examine 
assessments 



Miss*match 



Appropr iate-inappropr iate 
Objective-subjective 
clear -unclear 
Appropriate*inappropriatc 



Data Collection * All participating teachers were observed extensively in the 
classroom context by one of four researchers* The fre^ency and length of 
observation varied^ depending on the researchers level of understanding of 
assessment procedures* £ach teacher was interviewed! often on several occasions r as 
were students* Further^ each teacher provided records and documentation of 
assessment and grading practices* In each caser principals were asked to provide 
documentation regarding assessment and grading policy* 
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CHAPTER 2: REVISION OF THE PROFILE 



At the co«iipletloii of the high school observatlonSf the researchers agreed 
that the profile of classroom assessment environment elements generated fran 
study four cases was inadequate and needed major revision. For that reason^ 
the research team initiated a major reevaluation and development of the 
profile instrument* The result was a refined and much clearer set of profile 
elementSf each of which was accompanied by a concise definition and set of 
scales upon which to describe a particular classroom* £ach scale was defined 
in terms of key questions to be answered on the basis of assessment, 
observation or interview to carry out the rating* The revised profile is 
presented in the chart that follows* 



• •••••• 



CLKSSROOH ftSS£5SH^ EtTMRC^lKEirr PPOFILE 



Factor IdafttHicltlrtft 



Oaflnltion Of Factor 

f>«tcrlptlcn o£ ttie v«rloui roll oC 
■Mimint tit th« cliiiroott. 



At Diagnosing Indlviduil ni«di 
oC jtudinti 



Idintlfyiug itudent itrengtbi 



fiMdfl ocrosi ■ groq^ oc jtudents 



Kiy mieiLlons to Answer 

Uov inJoEpad i« tbt UaoImt 

About laob purpof s7 
IkH* rilevant ii tbit pocposi tot 

tiM conUsst? 
Dosi th* t*acbtr Ii* tlut um ct 

■MVSMinti IJ vtlasbli to ttim7 
Dosi th« tiacbttr In Cict jmi^ 

■«a«MMntj in tbtt vsy? 

Inforaad i 

Ij tht tiaohsr ivtr* oC indivlduil 

dlCCi nncM? 
Cm th« ti«ch«r ^iclf/ ways to 

dlsgnOM? 
Hit th« ttaohtr d«ivtlop«d th« tool! 

to di«9nOM7 

Ift th« viUrltl uitn^l« to 

lndlVl4»l iSAtion? 
Dost ths ttudsnt loid r««listlcaUy 

illov lidlvlduiimtlon? 

UJtCuli 

IS this uss oC isssssMsnt psrotlvsd 
by tbs tsacber it vilusbli 
snd us«Cul7 

Us#d i 

Ii it liist tnctruction 
mdividJillisd? 

Infofsd t 

Cin ths tischsr 9<tciCy wsys to 

dftsot n«sds7 
Csn ths tsschsr 9p%city wsys to 

sunsrlss 9eo^ ssssssasnt results? 

Relsvsftti 

IS groi^ dlsgnosis useful In this contsxt? 
ussfult 

Does ths tssohsr vslus this strst«9y? 
Used ! 

Is there svldence oc such diegnosU? 



Maaauccafent Methtid 

Orel asgeeswent 

HsAOSCCher Jodgnent based on 
obssrvatlon and interview 
self report by Lei»Cber 

Obssrvstion of clasaroai 



interview 
oral aa^esenent 
Obaervstloiw Interview 

Obesrvationr Interview 
Obse rv at loiw i nterv iew 

Interview 
Observation 



Oral asseaa»ent 



Observation^ Interview 



interview 
Obaervation 
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Factor M«nt It lotion 



D*giftltlcft of Factor 

D^t^minlng lttt#t gtad«t for 
c'jpott ctcdt at £««4b«ck to 
■tudanta and patanta 



G<0^Pin9 for inatcdCtlon 
within olaM 



Subdividing a clai« i>^to anall^c 
iMtcuctlcoal gcoi|p« on auaamttt 
catulta 



Idanticying atudcnta foe 
apecial a«tvlota 



0al«ctlon CoE placaakant into 
•dvancad ot t«Mdlal Pco^cuu 
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KaV QuaatiMa to toawat 

IhfotMd i 

aai tb« te«cbet oonaidtMd 

•lt#EO«tlva ingc^dlanta? 
Do4a th» ta«cbet h«va a aound 

pblloftcphy itoout ImgE^dlants 

mnd tbelc wai^btlng? 

Rflavant i 

Art gtai&aa caquU^d tn tbla oontaait? 

Do^m tbt taAcbec ta9«i^ gcadas aa 
• valuabla uae of auaaasant caaulta? 

DoM tht ta^chec aaftUn gc«d*a? 
Infot— d i 

Do*a th« ta«ch«c batva i^^clflc 

nMona for gioyplpg? 
Do*a th« ta«ch«c batva i|pa?lflc 

Mttboda of gioyplng? 
Cmti tha tsaohac ^Ewclfy a atcctagy 

tet luing aMommit cMuita in 

gtot^lng ptootaaidfltb cationala>? 

italavant i 

Do*a gtoiiplng mka a«na# in tbla contaait? 
uaaful i 

Do*a tha ta«chaE valua aift^Mtnt 
caaulta 1*^ giouplng? 

Uaad i 

Doa« tha taach«c actually gcot^ ui«d 
cn caaulta? 

Iftfomaa i 

Do*a tha ta«cbac kncM aaUotion policy? 
Can tha Uachac bav* ^olflo atxateglaa 
for uaing auMMMnt tn this ocnteait? 

Balavant i 

Do*a tha taiohac pl«V a col* 
aal«oticn? 

uaafujt 

Do*a the taachec laa thla aa • 
valuabla of aaaaamnt? 

uaadt 

Do*a tba taachec aalict ba^ on cMUlta? 



« % m m 

Meaautta^it Mathad 

Oral a««eaa»ent 
Interview 

Policy anatyala 

Iilt6tvl«W 

Obaecvat Ion 

Intecvl«w 
Oral aaattsasent 
Oral aaaeBawant 

obiervatloit, lntecvl«w 
Intttcvievt 

Obaatvatioit 

Oral aiBoaaMnt 
Oral aaaesenant 

Policy analVaift 

Interview 

Observation 
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Dttinitifw of fictoE 

tiling ■M««ui«nt or ttw pcctq;»*cfc of 
■ MHIptCIt to ctuM ■fcudtnt* tc 

uiiog iMtttncnt for puDlihiiitt 



of « putLcuUv LnifccucfcLoMl 



■)qp«CtAfcLOns 



Infoc»Ln9 itudent* of th^ nature 
Of th* contint «nd ■kllli ttiay in 
to Icirn 
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Queitiool to Aniwar 



lofo 



Cm th* fci»cb«r ^piclfy maoni for 
uiin9 «M«Ment this My? 

for doing w? 

Oou It Mki «Qni« to UM ■Mt«iftenfc 

•< • COOtEOl MChjmiMi? 

CODtlOl MOtLV«t«7 

Do«« tb« tiftob«r |(]iotr tK># to ■viluit«7 
I>o«ft tba t9ftob«K b«vi ip^'^ific 
■vtlufltion «t»t«9L»t 

fiAlivintt 

DoM it B«ki flinm to ivaluflt^ thi9 
invtruction? 

OMfUl l 

Do*« tb« tiachtc f«il «vaIuitLon is 
iApoctant? 

Omo i 

!■ tiwci «vidii)c« that «!valmtlc4ti 
■n conduotad? 



Mgaaar^cnt Method 

Oral aftiatitoent 

Oral aeeee event 

Observation^ interview 

Interview 

Obaervition 



oral acscasMnt 
oral aeaeeBK^nt 



Observation, interview 



Interview 



Observation 



loforped i 

Cat) the taacber aita alternative 
atrata9i«« for comnicating 
atqpacU tiocka in ganaral? via aueaawmt? 

Relavant i 

la it important to ifttona atudentd of 
ajq^aoUtiona in this contaict? 

Oa^ful t 

t>oea tha taacher aee aueaaftent a 

viluabla vahicle &>r «ucb coMunication? 

iittd> 

fiota the tether uae tbla vehicle? 



Oral aeddseraent 



obftervationr intervleiw 



Interview 



Observation 
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r*ctot MintUlcttlon 

1< C«vMinLCiting •Cf«ctLv« ot 
bttbuviotil iJ^iCtatlofi* 



tctConlng ttudinti of tb* luktun of 
tbtt ittltudM^ vAluitt pcif^cinc«^ 
•nd belMviocil pstteciuk thAt «n 

ACCiptAbli 



J« Providing test tskLng 



FwLlLicLiLng itudinti Mith itm 
typ«s «nd te»t oonditL«rw to 
pc«pa» tb«i foe futuci tetfti 



R«lAtLvft i^tttMM of 



DtttAnlnlng tb* ciUtLv« livoctanco 
of thMe pucpotM to th« tiiohic 
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Oo«i til* t«ACbttc und«citaDd bow tbii Oral amesnent 

»L9tit btt dttti in 9«niCil7 vLi 
iutMVcnt? 

Bflfvanti 

t» it liqportint to ooMUiiiio«t« 'i^ob Intervie^^ ofcEecvation 

ii^^otaticmi in thim coftt««t7 
vi« iu««iMAt7 

UMfiilt 

I>o«i til* tiAcbec Villi* tbi» uu of intGCvi«w 

I>o«» tb* titcbttc ufl* iUiiiftVRt In 
this w«r7 

Dots tb* taacbttc undicitaod tb* 

pOMibli b«nifit» of thM 
i>o«i tb* tiAchac knCMf ij^ici^noes 

tifbt be h#lpfm7 

miivant > 

|» tftSt-tAking ikill liktaly to o» Observationt interview 

livocunt In thU conttt3tt7 

^jieful t 

Doe» tbe tiacb«c vilua this Qta Interview 
of i4F*aaaainit7 

l>oei tb* tiacb*c u«i aaveaaMnt Obaervation 
In thim t«y7 

Given 100 pointa to diatcibuta (i) Wuest ionnaice 

eoroaa tbi«t 10 purpoaaa^ ham would (2) Aeaearchec^B obaecvation 

you diatcibuta tbMi to aho^ tb* 

calativa livoctance of tb* vacioua 

deciaiovta liated7 Tb* nora pointa 

you aaaign to a puipoaa tb* nora 

iwportant it ia to you« 



Oral aeaesaaent 
Oral afiEe«a»ent 
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WfLnltkM of Fiotoi 



Mtobingt fill-in ind ■■My t^^t^ 



2. T«xt-*««beddtd ■c^ p^^cil 



pcovldttd by tb* t^t pti>)i-Uh*i 



3* P«ifoe»anoe ■■iV«tt««nt^ 



■tudent piodocto h^uviotm unA 
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heaBuc^awit It^t hod 



!!■■ tb« t^«ob*i b««n ti^lntd In interview 

t^^t davalopi^nit? 
Oo*^ tb« t«A0b«i d^lop u^t blueprints? OUervitLon 

Cm tb« U«Ob*r idintlty tiiLti of Oral a«aeflfi«ent 

sound uit it«»»7 

HOW dot! the tMchai dititBlni tut Oral aMeoanetit 

quality? 



C«n MUiLil Uttfbt be tHUd vie 
tbU MtbDd? 



ObiievatLon 



uietul i 

&6oi tbe ti«ch«i think tbli setbod 



Interview 



Ooei the tiadiee In fict um thli method? 



ObiervatlOb 



Intomed i 

Ooei tbe tMt Offer iMesftttnti end 

tbe UAObei of tbw 

Hi« tbe tiaobei evel^iited tbe •WMiMnti? 

Acooidlng to t^iat cilteili? 



Obcervatloni inucvlev 

Interview 
Ottl e^eoAibent 



Helev»nt i 

Cm Mteilil taugbt be tiiiftd vli 
tbli wttbod? 



Obierv atlofi 



the tiaobei tblnk tbli method 
li useful? 



interview 



Uee4l 

Ooev the tieohei In fiot use tbU Mtthod? 
iitfo»ed i 

An ■MidiH clier and lepnimtatlve? 
Aei tialts to be Meatueed itnd peefoiaence 

cilteil* clierly eta ted? 
Art eooilng peooeducea ipelled out? 

do«a tbe U«ohee deUntni quality? 



Obfleevatlofi 



Obaervatlon 

inteivlewr obeeevatlofi 



Interview 
Ofal aaaeaMent 



Relevant I 

Can mateilil taught be taatad via 
tbja Method? 



Obseivatlofi 



aaaful i 

Poei the teeobei think thla method 
U uaaful? 



Interview 



u*fdf 

Doei the taaohee in fact uae tbla method? Observatlofi 



• • • 



ouring inatructLcft 



SUndtr^UM ti«ti Soboolf dlitrLotf jUt#*wld* or 

publiilMd tfljti 



CD 



togithtr tor ■ groMP gr^dc or «n 
LndividuAl gr«d« 




KtV Qyitloni to Aotwtc 



Hii»ur#Mnt Method 



An ftll jttid«ftti poailbli ri^pond«ntj7 
Dots the tttAobtr mit lor ■ ri^ponM? 
Ij Juatttlning tiedtMicIc given? 
Com the Uftobvr wrLttio reoocdi? 

Rglevmntt 

Cjm MUrLil uugHt be t»t#d 
tbU »ett»od7 

OoM tb« timber tbinic thiM Mtbod 



ObsenritLcn 
obeervatioft 
Obttervitioft (e«« part 
Obnervatioft 



Obaeifratioft 



Interview 



i>oee tbe u«obtr In fact use tbii »etbod? ob«ervitioft 



In^jnaedt 

t)K»ei iht teaotter undaritetid dLttarei^i 

mooi teete? 
Can the taacber interpret teat ioorae 

accurately? 
Uott doee tbe taacbef detenalne tbe 

quality oC euob teete? 
aaa tbe teacber been trained in 

atandacdlted teat vee? 

Ralavtnt t 

Can Mterial teugbt be taated via 
tbia Method? 

ui fffciXt 

Ooea tbe taacber tbinic thiM netbod 
ie uaatul? 

uiedi 

Ooea tbe taacber in tact uae tbla nathod? 
Intopeed i 

la tbe ta» i^t awara of potential 
problew ^l^h a laoK o£ Independence? 

Ooea the ta^ber b«ia atri^U^iaa tor 
avoiding tboae problewa? 

ftel^vantt 

Can iwurlal uugbt be taated via 
tbla netl^? 

uaaful t 

Ooea tbe taacber tbinic tbla netbod 
iM uaeful? 

u»edi 

Ooea tbe taacber In tact uae tbla nathod? 



oral AftsettfliBent 
oral as«eaa»ent 
Interview 
Interview 

obaarvatlcn 

Interview 

Obaarvaticn 

oral assess Bent 
oral aaaesaeiBnt 

observation 

Interview 

Observation 
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Opinion! of othvt tttaohvti Po«ltlvi or nt9itlvt £**lingi About 

ly collitgiici vttbally or in 
written record!. 



(fi«# #11 b«law> 



HiMuriiq itudiAt*! tblnkiiq •kllli 
thcougb tlw ippUoatlon of Bloott*i 
ttatoncm^ ot mi equivilint 
■true tun 



Regolar hoittwork iMidratBit^B Periodic ■Ml^iMienti designed to 

providi prectloe ind yiild 
infornAtlcn cn itudint ptrforMnce 



IfV Oi—titme to Anewc 



M*ifluria*ftt Mitbod 



Inloj»ed i 

II the tieclwr lentltlfe to iumi Oral aMeasMnt 

ti blsi? 

HOW doM the teecter ivAlueto the interview 
qoillty of «uob inforwitlon? 

ttelivant i 

Cm Mterlil taught bi tilled vli Obeervetlon 
this petbod? 

tie If Ml I 

Doei ttm tiecher think tbU Method interview 
is ueiful? 

Uee di 

Doee the tiedier in fict uee tbli Mtbod? Obaervaticn 
infbr—d i 

Doet the ttecbtr bwrt ■ taxoncny to Interview 

use cegularly end coMletently? 
Can the tiaoher aek queatlona at Orel aeseaa»ent 

dlffirenfc laveli? 

Ralavant i 

Can Mfterlil taught bi tilted vi/ Obeirvitlon 
thU pet hod? 

meful i 

Don the tiecher think thli method Interview 
ii ueiful? 

, U , Be di 

Doei the tiecher in fict uee thli Method? Observation 
tnfooMdi 

li<kw doei ^he tiiiOhir evaluete thtr Interview 

quality of iaelgiMiiht-9enerited data? 
Do aaeigtMtnti hwri i Cliar let of interview 

ijqpeotati^xke? 

Relevant ; 

Cm Mtft./il taoght bi tiited vii ObeervatJcn 
this pet hod? 

usifuli 

Does the teaoher think this method inteicview 
ii usifol? 

Doei the teacher In fict oie thii method? Observation 
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factor M«tHlcatlflft 
10* 8feud«fvt PMC catLi^t 



DatlnltlOft Of yiCtor 
Stud*nt# ctt* ■•ch otbtct 



11* Stud«nit cfttlnga 



ptcfomnct 



12.. it«lttLv« i«pQrttnc« ot 
« It hod* 



tb«tt » isaMftMnt Mtboda tccOM 
■11 puiposii 



13.. CognLtLv* lev^lt of 



E^stvnLfkLng ttw Itvtlt of cognLtLv* 
cpecttLon uppta by aifftrent kind* 
of oUttroon ■■■■■Mtmts 



ERIC 
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KiY QUtatlona to Aiwt MeaBUrMgnt mthod 

Infojawd i 

Do*! t«*ob«r knov ttrtUslH for 

doing tbU? 
tt tte toactor awtro ^ ttw oondLtLoiu 

timt MAkt It vtlld ana rtlL^t? 
Can tbt toacbar ipoclfy InatruotLonftl 

t>«ntfLt« of thlt utt of ■satMMtnt?. 

tt»l»yi!^ > 

Can mt*rLal taught ha tea^od via oba« dtlon 

thia nattod? 

Oaaful i 

I>oa« tha taachar tblnk thla a^tbod intetvLew 
ia uaaf ul7 

Paadt 

I>oa« tba taachar ^ uaa thla pathod? Ob&arvatLon 
lofoawd t 

Ooaa tha taacbac know atcata9Laa fov 

d0LD9 thla? 
la tba taaobtc awara of tha ooodLtLona 

tbat Maka It valid and caliatala? 
Can tba taaohac ipaoL^ InatructLonal 

banaf Lta of thla txa of aaaaaaaant? 

Balovat>t > 

Can wktacLal taught ha taatad via obdervatLon 
thla awthod? 

I>oa« tha taaohor think tbla Mtbod intervlaw 
ia ua«f ul7 

Ooaa tba taachar In fact uaa thia vatbod? obaarvatlon 

OWan 100 polnta to diatrlhuta *oco«a Quaatloimal re 

tbaaa » aaaaaaMant Mtboda^ how would Obaervatlon 
yau dlatriUita tb«tt to 4how tha caUtlva 
iapoctanoa of aaoh to yoii7 Aaal^n aora 
polnta to tboaa Mthoda tbat aca ttoca 
lapoctant to you* 

Bow do takt atody ^uaatlont and Obaaxvatlon 

asal^rmanta dlatrlhuta tb«Mialvea 

acroaa lavila? 
Bow do Oral ^uaatlona In olaaa Oh&arvatlon 

dlatclbttta thawaalvaa? 
Bow do ^uaatlona on taat and ^ulkxu 

dlatclbuta thaMolvaa? 
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14. 8tvit«9io for int*9ntti>t| 



DaflflltliMt of Fictor 

cily Oft ■MMMt •» • uachlng 
toolt ttjoh ■■ US! of pm^t •dlting 
pioottdacM to teach welting or uit 
of pcactiot tMt» to pc^tc* foe 



1S« Datllng with cbtttlng 



StcttoglM foe wlntMlilng cbMti»9 
«Ml attllng with It whin It oocuct* 



Aftvtment of ACf«ct 



Ht««ici»9 thoit tff^ctlvft tnd 
•ocltl chAract«cUt ic« of »tudtatft 
thtt pity ■ EOl« In cltMrooi 
dtciflico Mking 



1. ObMCving inllvldaal »tuaents 



Iftttcclng tfftctiv* tctlt» tt<M th« 
obfltcvttlon of ths hehivlor of 
indlviaul ttuaent* 



to 
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Key Qutationg to Atutwt 



Hewutttwent Hat hod 



Cmn th* tt*ob«c q»tclty mcb ■tctttt91t»7 Intcrvlev 
DoM th% uactMC knov cdvint^ea Othl a«8«ssMent 

■nd ItMlt^tlona of taoli? 

Do#» tb« t«acb«c uM th««* »tctt«9lM7 
Ift£oi»»d > 

Ctn tb« t«#ch«c oitm iptoiflc w«yt 

to «lntMlH It? 
Ctn tb« t«acb«c cl^ qpttdflc ftctlont 

to dttl with It? 

Do** tbm ttacbtc tiM tfa«ft« ttctttglM? 

Do«# tbt t^actwc htv* ■ clvst MQtft of Interview 
tctit(t) to be Miturvd? 



Interview 
Intecv lew 



Infowd > 

Do** tb« ttftQh«c UM clt«r ptcfomancw 

cciteclt? 
Do*! tbe ttacbec M«Pit b«ti«rioc 

cepcMtn t4t 1 vi ly ? 
Do*! th* teacher know the Pitftllt to 

eound dete (i^g** <*<>•» the ttacbec 

keep wrltttn ceoocde)? 

fttltvtnti 

Ctn the tctitte) to be »tteuced ht 
»tteuc*d vlt tbl« set bed? 

Ofeful > 

Do*! tbe t«acbec ct9«j[d thlt method 
■• ostful? 

Uefdi 

Doee the ttacbec 1a ftct teaeet thlt way? 



Interview 
Obeervttloo 
oral asaessnent 

Observation 
Intecv lew 
Obeervatloo 



3 



2^ ObMcvLng gfoqp LnUc«ctLoi4 Inficclng ftef#ctUi tcsLti ttm 

obtMcyitLOD Of tU 9ooi«l ^nd 



3^ OiLtig ^uiitLotmiLcH Pif«c ind piocLl irutcwint* used 

to gctbac ftCf^otlvft diU 



•xoh«tig» of Lcvfor»«tioiv b«twMn 
tttMhic Mnd itudintf*) to g«th»c 
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Itiy Quaitioft* to Aiwt 



Ititoxmmd t 

Do«i tbt t*iich*c uM oliac picforMDc* 

ccLUcLi? 
Do«i tbt taaolMc suipU bA«^Lor 

npcwinttt L V* ly 7 
Do«i tba t«#cbac Imov ttk# pLtfilli to 

iound dftta U«s*f doM tba t«*chir 

»«uund vLi tbl« Mthod? 
Do«i tbt t««olMc ci9»cd thiM Mthod 

UMdt 

Do«* tbt t«*cbac in fiot tbU «Ay? 

Infbe—d i 

ikM tbt tatobtc i(ncMf tb# bMlc 

t>o«i tbt t«tcbtc imcMf •dvwtwgM ind 
llwitAtLonm oC quMtiocinti v*t7 

C«n tbt tctltU) to bt Mttuct^d bt 
fttiiUC^ vLi tbl« Mtbod? 

Doti tbt titcbtc ct9^d thli Mtbod 
i# utiful? 

UMdt 

Doti tbt tttcbic In ftct tblt w«y? 

infoiMd i 

Doti tht tttobtc kiKw tbt ktyt to 

tfftotlvt inttv vising? 
Dott tbt ttMbtc knom tbt tdvtnttgtt 

titd llpLtttLoot of Lnttcvitwt? 

Htltvtnt i 

Ctn tbt tctLt(t} to bt Mttortd bt 
MttUMd vLt tbit Mthod? 

tfatful i 

Dott tbt ttMbtc ct9«cd tblt wthod 
tt uttful? 

uatd i 

Dott tbi tttchtv in ftot t«Bt«a tblt «ty? 



intervLtw 
Obfttrvaticn 
Ortl tsaesBsent 

Obfltrvtticii 
Znttrv L«M 

Ob«tcvttion 

Octl ttttttftwent 

Oc^l {iMtsflnent 

ObtftrvttLon 
Interview 

Ot>9ecvation 

Ocal 4ibi!€Btnent 
Oral taseBSaent 

Obatrvation 

Interview 

ObBt written 
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FMiitot M«tiilcatlfli> 
S. Oplnicoi of otter teacteti 



Baflnltiw of rictot 



Com«ftti About itud^nt «if«ot 
obuinod ttcm ooUi^u«fl vttbaHy 
or vii pMt fltudint tio&Kdi* 



6* Oplnlcni of otbat atud^ttti 



CoMiin^i About fltttd«nt «if*ot 
obtAlnod tt<m otlwt fltud«oti 



7* Opinions of pit«ivts 



CoMintfl About «tud«at «if«ot 
obUlnod froM th« itudtnt'i pArint 

or giMtdUn 
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Kiy Oneitioni to Aftiwr 
lotoiaad i 

Do«i th« ti4totMt kncm tbm idvantAgH 
tid ilaiUtlocw of Qplniofu of othtti? 

ftiliifAnt i 

Ctn th« ttiltCfl) to bA ««uut#d bA 
««iwc«d vU tbU «ttbod7 

IJiiful i 

OoM tbt t«Ach«t t«9«td this Mtl^ 
D— d i 

0OM tht tiAohtt in fiofe ■«#••• tbli viy? 
ItyfQiptdi 

■na liMitAtlcni of QpiJiioM of otiwti? 
RAlivnt i 

Ctn th« ttilt(i) to b« MkiutAd bi 
Miwnd vii tbU ettbod? 

jJIUfui* 

OOVI tht tiAObAt t«9ftCd tbifl ikttfaod 
• • IM«fUl7 

bOA« tht tiachAt In ft«t AAAOAA tblA WAY? 

InfbMwI i 

DOAA ibt tAA<;hAt klXM tlM AOVAntAgAA 

And liMltAtionA of opinion* of othAti7 

CAH thA ttAlt(A) to bA «AA«Uttd bA 
«A«AUtAd VlA tblA WAtbod? 

tfjAfUl l 

DoAA thA tAAchAt tAgAcd tbli m%tU>d 

A A UA«IU)7 

tlAfd i 

DOAA thA tAAObAt In f ACt AAAAAA tblA 



HAAOTTA^ent HAthod 
OtAl AAAAAAMnt 

Obo^^Atlcn 
IntA^lew 

ObAAWAtlon 

OrAl AtseBSMnt 

ObAACVAtlcn 

IntArvlew 
ObAATirAtlcn 

OtAl AAAdAA»«nt 

ObAAtVAtlon 

IntAtirlew 

ObBAtVAtlcn 



^* Put lUHlant c*oonl# 



Dittlnltion of Fictot 

ociw inficino*! ttgicding Af£#ctLv« 
oluic4at«cLitl€i fcoi Lnfoimitloa 



9* AffAOtLV* tmti tt«U1II«4 



10* COMt*lUtLCO of Af£#CtLV* 



D*t«c»i«ilng lUtdint tciLti tMtctmt 

than 7 IMMIMflt Mtbodc 



1. Maiming ability for t*«cb«c 



Op^citlonal aiflnltiofi of th* 
ability oOMtnict i«i tb« vLiw of 



2* Impact of ■bULty ■Mimtnt 



CliMcooi dftcULofhft LnClu4i)o«d by 
C»ulti of ■DLllty iMMlMnt 



0* TOXt AMMUilntl 



ContcLbutloni of ttxt't^ddid or 
tMxt ftoooppanylng MticLili tbit 
contclbut* to th* ■M«»Mint 
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lev OM«itioM to Aiwt 



HflA^urgaant Mrthod 



Do*i tbt tiacbtc ithow iibit UifonutLco 
U coAtiliMd tten? 

Ci» tb« tcilt(i> to b« tt«Muc«d b« 
MisttC^ vU tbU ttttbod? 

Dot! tbt t*«ob«c ci9itd tbli ttttbod 

Dot! tbt tt«obtc i«i fact twtst thU wy? 
Litt tctltt tttHtUCtd 



obtecvAtlon 



intocview 



oiwtrvatlon 
IntecvLewt obettvttlon 



OLvto IM pointi to dUtcibut# tecott 
tbttt 7 tM«M»tiit Mtbodtf bow would 
you dUtcLbut* tbta to •bow tbt 
ctlttlvt lif>oct«iiot of ttcb to yoo7 
Attlgn imt pointi to tbott ttott laportAnt 
to you. 



Qi»ttionn«ice 



It tn tblllty ftotoc iiNPOcttnt fov 

tbt ttMbtc? 
Dott tbt tttcbtc tttttt tblllty? 
tittt Ingctdltflitt dott tbt tttobtc 

Inolodt? 

HOW dot* tbt tttcbtc sttturt ingctdltntt? 

tftttt dioUlont tn LnClutnotd? 
Hbtt rolt dott tbt f ittWMnt pUy 
i«i tbt dioUlcntt)? 



Inttcview 

Interview 
Interview 

Intervitw 

ObeervAtlonr interview 
intervltw 



Whtt t««t«ta«f)t covcontntt trt 

tvtlltblt froi tbt tent? 
Nblcb ot tbt ooapontntt trt u»od7 



Obttrvttlon 



Obtervttloo 
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ill. Cftmm tlBBO Iri SBLIOJMA 
A. Itiaulti fit pucpcm 



D»f iftu^ Of yftcteor 
Factor! coitfid«)c#d by tb« t««ch«r 

Ri^lti of «MMmint proBl«« to 
fit te«ch«)c'i Infomtlcn iiMdi 



B. Mitbod OAtchii ifitinM outconii 



Mitcb b«twi«n tb« ■uiMAifit foe 
«iia tht itudtnt cbiraoUriitic 



C, liieo of a«v9lop»«nt 



Aftoufit of ttaij iffort *ni 
ticbfilcvl ■kill r«quir«d to 
awiiAM^t mtbod 



D, E«i« of ao^rlng 



huourt of tlM«j Iffort ind 
t«cbnicftl iklll r«qulr#d to «cori 
■■•■■tAent 
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K»y Qiiaitioni to An^yc 



H»A>u recant H^hod 



I»>foni<d > 

C«n tU ti«ch«r aiffir«otl«U 

InfocMtloik n««ai of various purpoaw? 
Cm tb« tm%o\mt aifUnntUU 

«MMni«nt» mkiy to m—t aiffirm 

InfonMtion n««dft7 

DM! titt UAObar nma thli crltirlon 
It! JaporUnt in aelvotlng? 

Dmi tiM ti4icb«)c oonsidtv tbU f«cto)c7 
InfojMd» 

Cm th« ti«ctMr aiffir#fitl4l ««ite«»«nt 
focMU that will r«fl«Gt aiffiKsnt 

Iapogt4nt > 

Do«i tb« ti«cb«r nmd thli «rlti)clon 
■■ iapojcUfit in itivotlng? 

Do«s tJtt t«4icb«r consider khU factor? 
Info twi t 

Cm th« ti«oh«r aiffirintUU AB««fiiM(t 
Mthodi in tmtnm of ifflcltncy? 

laporUftt * 

Do«i tb« tisclMr n9*ra thli crUirlon 
■■ Japorunt In ■•Uotlni? 

Do*! tb* tiftOhtr consider tbli factor? 
Infom#d > 

C«n th« t««ch«r dlffi)cintiit« dUfSiMnt 
Mthods In t^KRe of •coring «fflclincy7 

l|£9£t}gt» 

Do«i tiM ti«ctMr ri9*rd thli crJtirlon 
■■ i)^Art«nt In eilectlng? 

tl>ed > 

Doei th« ti«ch«r consldir tbii factor? 



oral SEaeasaent 
oral asttaeanent 

I ntarviev 

Intar^fiev 

Oftl aaaeaeae^it 

Intaic^flcv 

1 ntarvlcv 
Oictl aaa«aaB«nc 

Intar^flev 

Intar^fim 
oral anaasanent 

Intac^fiev 
Intaic^fiew 
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Origin of ■■■«MM«nt 



Ottlnltlon tit y ictor 

P«r«oo origlittlly nipoMlbla for 
div«loptn9 tlM iiMiMnt 



r, Tim r«qitlr%d to adslnUt^r 



Tilting uolti «dMlnlit«red p«r tmlt 
of tlM 



Oftgcee of obj^tlvlty 



ftMOUtit OC tMCbttf lud^iinft ttwt 
^1 Into th« «corln9 proovia 



to 



Acplic^lllty to Miiurln^ 
hl9^r ocair thinking iklll« 



Kxttnt to whlcl? iiiiiwinft c^n m rve 
to «iiwr« moc* ttM rio«ll of 
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It^v Gixitloni to Aiwt#r 



Cin tb* tiiobir dlffirintlit« quality 
fiotori bJiMd cn d«v«lop«r7 

l>oii tbi Uiobir ri9«ca tbU orltirlcn 
M la^rtAnt In iil«at±ag7 

l>oii tbi tiAcbir oofwldir tbii factor? 
intoawd i 

Cin tb* ti«cb*r dlffiEvntli^ b«ttmn 
i«t#ft«iint £or«it» b«i*d on ifflclincy 
of itM i^Ui«tritlon7 

laportMrt i 

l>oii the t^Acbtr ngard tbi« orlterlcn 
M la^rtAHt In iiltotlng? 

jfwdt 

l>oii thi t««ch«r ooDbldir tbU factor? 
iitfoaMdi 

Cin tb* t«iobir dlffirintlit« tiit 
fOcMftti In XMtam of objiotlvlty? 

IS^rt^ntt 

l>oii tbi t^Acbtr ri9*r<l tbli crlt«rlcn 
II ln^rt^nt In iiltotlng? 

thMdt 

l>oii tb* tiioliir oonildic tbU factor? 
infoontili 

Cm tb* t#»ch«r dlffirintlit« Mtbodi 
In t«i«* of idiptiblllty to highir 
oiAir tblnklng? 

laporfnt i 

Oo«i tb* t««chir rigud tbli ccltvrlcn 
II lii^rt«nt In i*Iictlng7 

Uifd t 

Don tb* te^chtr oonildir thli factor? 



OraJ asiesswent 

int«tvl4M 

intervlttw 

Oril asses^aent i 

interview 

intetvUitf 
Oral a««eiAjyent 

interview 

interview 
Oral ase^eaimt 

interview 
interv lew 
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fCtOt Id«ltlflcittfll> 

T* HffcctLvt control oC cheating 



Dctlnitlctt of Fictor 

Contribution of ptthod to teat 
■«carl^ ■r4/i>r itudy copyln9 



Rilfttlv» l«port«no« ot crit«cU 



ReUtlvft 
1 to 9 abov« 



■ li given to crlt«rii 



IV* ^jtLm or AsAffSHoits 



h* r«[>tr ind pencil MtevMientv 



to 



MtrlbUtll of MtHB^Antft th*t 

cootrlbut* to tbelc dependability 
«fficl««iy 

teacbet*de«e loped or text*te>^edrted 
liultlple^boioej true/fAle^ 
Mtohlngr flll*in «n4/or eeuy teite 



li« Perforwince A&eesenents 



JVeeeenent baeed on ob«ecvetlon «na 
profeeelooel Jud9»ent 
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itey itueetlflfte to J^n i«« 



MeeauceBent Method 



Cen te«»ber dlff«rentlet« Metbodft In 
terae of euiceptlblll^ to cbeetlng? 

l<pogf nt t 

Ooee the te«o)ier r«9eEd this criterion 
ee Ipportent In eelectlng? 

Ueeg t 

Ooee U» te«ober consider tbie facto t7 

Given 100 points to dletrlbute ecroee 
tbeee 9 criteria^ bolt would yau distribute 
t^m to ebov tbe relative isportanoe of 
tbeee crlterle In eelactlnQ yaur claearoon 
assesuMiAe? Jiselgn mon points to tbo«e 
ccltsrla given aoce velgbt In your eelaotlon 



Otel ««eMe»eflt 

Intecvlew 

Interview 
Uueetlonnalre 



Are tboee ettributss scoounted fot tbat maiinise 
tbe reliability and validity of esseseMnte? 



Nbat percent of tbeee asseMsents beve the 
following obaracterlatl<>ei 

Deeorlptlcn of teet ipeclflcatlcne 

Content coverage aatobing Inetructlcn 

Cognitive levels Mteblng inetruoilcn 

Maviwui Itetts per unit of tlae 

Itm format Mtobea Intended ootcoee 

Iteme oleerly written 

ite«e eauple doaaln 

Sooring prcoedurse plannad 

Scoring crlterle for eeeey Items 

Clear directions 

iJuellty repiDductlon 

ScbeduUd to mlnimUa distractions 

tahet percent of tbeee asseeemente beve the 
following cbaractarlattoat 

Trelt defined wltb levele «f proficiency 
Matcbee intended cotcomee of inetruction 
Minimises tJjM required to esseee 
Cleer performance criteria 
Studente eware of criteria 
duality eitticleee 
E^rcisee eauple dome In 
Itatlng ptooeduree planned 
Reeults matob information neede 



Interview 
Sxamine teeta 
fixanlne teeta 
Eaieaine teeta 
interview 
fixaaine teete 
Sitaalne tests 
Intecvlew 
Interview 
Sxanlne teste 
Bkaaine teste 
Intecview 



Interview 
Interview 
Interview 

Mtltten docviaentatlon 

Interview 

l$xaainc 0)eerclses 

Interview 

Intecvlew 

Interview 



Factor M«tttlflc*tlon 



Dtflnttlon at F^cti^c 
Lnit ruction 



A. Oril ifid ronvarbal fMdbicIc 



giVMi to Atudfinti by t«ach«r 

SptcLfLc fHturi« of tbli fon t>f 
fMdtwcIc 



to 
00 



B, l«rLtt«tt fe^b:ck 



fipiolflc fiiturfts of tbli fon for 
fWb«ck 



RLC 
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key t!uaitlon» to AtiMm e 



WcaBUfgaeftt Wit hod 



Wh«t percent biv* tti«M cbir«Dt«rUtLcii 

All itu^ti potintL^ rii|po«ka«nti ObservatLcn 

tt^chif waits for ■ n^onii obaervatlcn 

Qu««tL<MU Mtoh oognitWi Uvili OtservatLcn 
of objoctLv*t 

S^octm f^Mtbaolc 9Lv«o Observitlcn 

Mrltttn Moordt Kept Interview 

tfbit ste tbe ms^t ulLint feituric of aH feitures detemlned 

that fe*abflclc7 obeervatioci ond profiling of 



ftedbacic ev«nte 



Hitt percent at tbU Icli^ of f««dbick 
It glvao to Atwient* wbo trtt 

Strong v£ we«k7 
Cornet vj inoorr^ot? 
MtU J££ f enl^? 

tfbtt percent of thU kind of f««db«c;k 
tiec th« f'Jllotring cbereoterieticei 

Orel yin noovirbel? 
Pt^ic v± privite 
Piir ^ wfiir? 

FOGUiad icbievepent ^ effective? 

<3etM^e irreUvent? 

iMdiete v« deUytd? 

Positive va n^gitive? 

Delivered in cleie ve out of oleee? 

What percent Is 9iv«n to etudeots who eret 

8tco<^ weak? 
Corc«ct v± inoorrect? 
Hais SM f ^Mle? 

Mhet percent of feadbacic isi 

Ccewant ^ «VMbcl7 

positive ve n«9etive7 

Peir vt unfeir? 

Gersaae irrelevent? 

Fccuead on acbieveMot ^ effect? 

ooee the taacher uas aa^lss d 
psrfomnca as basis for feedbecic? 

Ooes tbs tsacher di^ley acMevwent 

raootds for public vieW 
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VII, THC TJEMItEll WD ASSKSSHBiT 
1* TisAcliing •)^rL«no« 



Deflnitlctt of Factor 



yMCft Of ei^rl^nc^ with vatIqu^ 
f «c«tft of LfittructLon 



Sourcoft of 4tMMi«i«m knotflidg* 



ComtrlbutLcn of virioiM tourcAn to 
tht tft«ober*i kno#l«d9« of 
« MM Mint Mtbodoii^ 



tte«clMr*ft tiwf expenditures 



LnttructLorwl tiM 



3, Auitment ti*e 
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Key Queetlong to A««wr 



Uov vny yMri Qf ixperLtnoe do you havit Interview 

In the teeohlng flel^ 
4tt yoor ourre5t 9r4de levtl? 
15 your current ecbool? 
wltb content? 

Given 100 poiDt< to dletrlbute e^coee Ouestl^naire 

tlie elteroetlve eourcee of kmnfUdge 

ebcut eeeeieamtf horn ifould you dletribute 

thote pointe bo itiow tbt relative 

oontrlbutlcn of eecb to yotic underetending? 

Aeel95 «oce polnta to tboee tbet Aide larger 

oofitrlbutione* 

Fceeervloe end grediMte teecber trilning 

iDeervloe tretaing ptoftreaa 

IdiM end eu99eetlcne of ooUeeguee 

iteedlnge txcm prcfeeelcAtl ll(ere\ure 

Guidebook e ecooMpenying texte 

0n5 cleeenw ewrlenoe 

Other (^eclfy ) 



Nhet perce5t of the teecber*e ti>e Obe<irvatlcn 
li ^enti 

planning? 

teaching one on oner 
(eacning 9rotpi? 
eeeeeeing? 

other (^e^lfy ) 

What percent of aeeaeMtent tipa le Obeervatlca 
^anti 

liavleiiiiKi and ealectln) aeeeeiMita? 
Develcpimi own aeeeiMinU? 
Main lete ring aeeeea»enu? 
Scoring eeeaeaaenteT 
tticoiding raeulta? 
providing feedback? 
Evaluating aeeeaaaant quality? 



Patlnltloft of Fictot 

CbiricUrUtlcj tbtt thm tmtctmt 
bclngj to tb» cUurM itMMitiit 



O 



VIII, T£hClCR'S FSRCfimOM 81UDOJT8 
A, Ability to liirn 



(Dt£in«d by tHcharf ■«ction 
II-C-X) 



B. MLllir^nMi to l«irn 



SirLouMniM of p;»cpQ«i In ichool 



C. AiU of jobiev«Mnt 



AMouat <^ wtttriil litriwd p«r unit 

of tiSA^ 



D. Miturity 



l£3ttm to trtkiob Jtudinta tmt« 
p«r«ORAl riipOMtbility tot 
«ohoolin9 



E. 8tM4y skLUi 
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Kty QueattonJ to hxMtmt 



HoM CM ttm UaokMr b« profiled 
In tMmm ofi 

Aol* li^ th* «l«««ro«7 
Uv«l ol ProfiMiontl iiqp^outioM? 
Ittftdt for itructuM In tbt cUMcoon? 
Diflnition of Ugb )otf q^^ility ' 
york? 

itttwit of jUfvotypinv itudtnta? 
AtUation to iimptioaAl Jtudtnti? 
sw% of p»rfonftDot tiotm? 
l(ind#noy to talt« rUJtJ In Inttroction? 
OrittnUticd to ohMtiW 
Aiwimt of obtJtlAg? 
ipporUM of proiptnw? 
OfianUtion to lnUtp*riotuil 
«Q*lt«fM«0t7 

Cocpirjtiv« vf oo«p»titiv« 
Attribution ot ftman for jiud«nt 

liirniog? 
BmU for 4r^tog7 
iDtifpMUtion of ■M*MMnt 

Uotm vj oritiriod ri£trmc«d 



Intitviw 
Interview 

Interview, obftetv«tLon 

Interview 

ObeetvatLon 

Obiervfttion 

IntervL«w 

Interview 

InUririew 

Obftitvitioo, LnUtvi#tf ■tudinta 

ObM rvation 

Ob«itvition 



Intirv L#tf 
Observation 

Observation 



Ij Ability td^h or lo¥7 Interviett 

Uov aucb vjriition In sbiUty tbere? Interview 

[>oM ttm taeoher eoooMM>d»t« verlntion? obMtvAtLon 

Ij vUlingneu bi9b or loi^ lnt«nriew 

How mieh verifttion in a^ULty im tbere? InUrviefw 

Doe' tbe teaobar «oocaso4ete irerietion? ObaervetLon 

IM •chl«ir«aent rete Ugb or low? Interview 

Ij rate Inoreaeing or deorea^ing? IntetvLaw 

How Mh veriaticd In ability im ttmn? Interviaw 

Doea tbe teaobar aoooaaodita irariation? Obeenretion 



Are tbay reiponaible ov irr«it>Wible7 Intarviaw 

Bow wiob verietion in abiUtV iM tbera? Interview 

Doee tbe taacbar aocoawodit* variation? Obeervetion 

^ ra tboee ahilla weU developed? In^ervi«tf 

Hem wuch veriation In ability ia there? Interview 

Doee tba taaobar aoooafeodete variation? OfaeervetLon 



52 



F* BocUl tklUl 



G* HlllingnMi to ptcfbrv 



6tudinU' wlllinaniM to 
4«onitc«tt lAiit ttwy know md ice 

Stcingtti ol itudtnt it««4i toe 



1, 6ilC ■■■UMibt ildlli 



Ability to 



■■ra* own ttciDgth* ind 



K. R««ctl«n to tilting 



Clmclty of iMsi ^ tAin •n 
i«t««iMnt ind/oc gcidt li Cilc oc 
unfile 

Amount ot invlity it tititing tiMi 



K** Fuintal i39«ctatlon 



Picmt'i vl«M of ichiftViMint iitt 
of itudint 



Vllt. SOUt OP POLICY in CUiSSflOOH ASSSSMMT 



A, Focu* oC ixliting pollciM 



AMeniMnt i^rftctloii ind ^coocdorii 

govocnod c^^ ofuvtiln^ by cuccint 



B. Otlgin oC ixletlng poiiclift 



t«v«l It iritich th* policy l4 wcittm 



ERIC 
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jj *¥ Qmitloni to An<wir 



All tfeOM iKlUi Mil divtlopftd? Interview 

Bov auob viclitl«n In ftbUlty U tbece? Interview 

Do«t tb« UACbic accciMdtt* viclAtlon? Obi^rvAtlon 

Ace tbiy wining oc citlotnt I[<tervi«v 

SOU auott viclition in nbUlty U tbice? Interview 

»o«i tb« ti«ob«c iOOO— nrtitt wlitlon? Otxervitlon 

All tbcM itc«og OC ve*k iim««7 mtecvliw 

How web vici«ti«n in Ability iM tbite? Intirvlew 

Doee tb« uaebec nceciMdau viclition? obiervation 

Aci tbofli iKilli Tfll d«Vel<9P*d(7 Intirvlew 

How Miob viclition in Ability tbico? Intecvlew 

Don tb« uaebic AoooMMdit« volition? ObtirvAtion 

How oim tbftt AenM? Interview 

How Miob viclition In ftblllty iM tb«ci7 Interview 

t^oee tb« te«ob«c >ocg»o<tote viclntlon? Observation 

HOW nnnlous «te tfaoy? 
How Mob ncl^tlon In Ability i^ tb«c#7 
Doe* tb« ti«ob«c «oooModitt vuiitlon? 

Aci thoa% laqptcUtloni oUu to thi 
t>«eb«c7 

Aci tliey blgh oc low iJf^iotatlonB? 
Ac* ttwi# iiqwctatlonB livact«nt 

to tb« UACbec? 

How wkoh vicUtlon In Ability i^ tb«ci7 Interview 

Does the ttwbic icccMwdftti viclition? Obeervetlon 



Interview, ^^etv^llon 
IntecvJew 
Observation 

Intetview 



^ cuccm P(>llcle« fooui oni 

Tilting ^cictloti? 
Meeting ci«ulti7 
HOMWocK ciqmc«A«nti7 
Clmsa lite? 

6ilictlon Coc ^cogcAM? 

AttindftDot? 

Contint to b« Uugbt? 



Policy anAlYfils 



Doii the ti«ebec know theM poilclii? 
Oc they i^iot ^c«ctioi7 It icj bow7 

Hbit policy mKici bivo wclttin the 
pollclM tbit gowrn claiiccoft 

iMelMMOt? 
t^AdttCll? 
&UU7 
DlltClCt? 

Scbool? 
D^irtnint? 

ColWlil tlnfomitlon ogc«e«*nt 
fltb «notb«c u«ujb«c)7 



Intecvlev 
Intecvlew 

Policy Analy«l8 
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CHAPTER 3: PBOj^ILES OF EIGHT CLASSBOOM ASSESSKEHT £NVIR0»4£I«TS 



Having completed the revision of the profile Instrument^ the researchers 
th«n set abctt the task of reflecting back on field notes and dcx:ument«tlon to 
complete the new profile for each classroom studied* The result Is a set of 
rich and diverse portraits of eight unique and Interesting environments. Each 
Is described In this chapter via written description accompanied (followed) by 
a completed classrocn assessment environment profile* Besults are then 
synthesized In Chapter 4* 
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MATHEMATICS CASE STUDV #1 



Background Information 

This description of the classrooin assessment environment is based on 
observations of instruction and interviews with the teacher conducted near the 
end of the 1985-86 school year. Her teaching day includes six class periods 
o£ high school algebra instruction^ generally for freshman and sophomores. 
She teaches Algebra I and ii^ including an honors section of Algebra II. The 
students are typically good achievers a^iring to college level math. The 
ttacher has over 20 years of experience in high school math instruction^ knom 
irtiat she wants to teach at irtiat pace and is confident that she knows how to 
teach and assess it. 



I. ASSESSMENT PUItPOSES 

A. Diagnosing individual student needs 

A small portion of each class period is given to diagnosing the particular 
difficulties for individual students. This normally takes place during 
homeifork completion tlme^ i.e. ^ during the last fiv« to ten minutes of the 
class period. The bleacher leaves most of che responsibility to the student 
for initiating these contacts. Because math problems (irtiether on a test or 
homework assignment) are precisely diagnostic^ the teacher can determine quite 
easily yrhen performance is lagging through daily contacts with her students. 

D. Diagnosing group needs 

TWO uses of assessment for this purpose i^ere observed. The teacher 
consistently uses oral questioning to track the learning rate among the 
students by asking ^bing questions and waiting for a resonse. In addition^ 
the consistent and regular review of homework reveals potential problems. In 
one instance* however^ the data i^ere undependable . The students scored much 
higher on a series of quizzes than the teacher thought they would based on her 
L^eview of recent homework. 



C. Assigning grades 

All grade information collected via assignments^ quizzes anC tests are 
stored on a computer for later averaging and transformation to a grade. 
Straight perceti cutoff scores are used for the transformation: 90 percent 
correct « A^ etc. This is a very visible dimension of the classroom^ with 
cutoffs posted in large lettei^ on the wall. 
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D* Grouping for instruction within claag 

There was no evidence of grouping seen during these observations* The 
teacher relied totally on whole group instruction and seat work (often with 
individual help) * 



E* Identifying students for special seicviceg 

The teacher had no responsibility for such identification* hll screening^ 
groui>ing and placement was done by the guidance counselors* The teacher ^s 
view is that she is to teach the students present in each class during each 
teno* 



P* Controlling and motivating students 

Besides the general control and notivallon exerted on students by tlie 
assignment-test-grading cycler there were other uses of assessment as a 
control mecbanissL* The teacher used oral questioning as a control tool by 
calling on inattentive or Inconsiderate students and asking follow*up 
questions until full attwtion was given and appropriate learning was 
denonstrated via correct answers* This often took several minutes* 

In addition^ the teacher occassionally implemented what was termed a 
^^participation grading** interval* I saw this in action only once during 
observations^ while the teacher reports doing this at least twice per week* 
Essentially^ the teacher judges **Qn task/off task" during this interval, which 
spans less than a class period* **0n task** gets a good grade in the gradebook 
**to counter seme of the low scores if the student needs to*** The teacher uses 
this intermittently and strategically at key instructional times to focus 
student attention* A scan of student on-task behavior during a participation 
grade interval every 2 minutes revealed an average of 1*5 students out of 22 
(7 percent) off task coiq^red to 5*7 students (26 percent) off task after the 
interval iias terminated* The frequency of student initated questions also 
increased during the participation time* So in this case^ the grade 
controlled student attention* 



G* Evaluating instruction 

By and lacge, the teacher knows what students need to learn, what they are 
learning and what instruction is needed* The teacher **generally knows what 
works and what doesn't work** as a result of many years of experience* As a 
results the instructional treatment is rarely, evaluated and revised on the 
basis of results* 
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H. Canmuni eating achievement expectations 

In mathf nothing communicates expectations more clearly than a set of 
problems to be solved^ according to the teacher* Sample problems are given 
and reviewed before tests. In seme cases^ sample items with correct solutions 
appear right on the test alongside other problems to be solved. 

I. Communicating affective expectations 

The teacher is very clear about attitude and behavioral expectations 
during class and uses oral assessment to illustrate and enforce those 
statJards regularly. She calls on inattentive and inconsiderate students^ 
demanding focused attention. 

J- Providing test taking experience 

The teacher uses "sbov^rk* problems only. Typically^ these are not used 
on large-^scale tests. She doesn't care. Her task Is to teach math problem 
solving skills. She feels show work problems are the best way to assess these 
skills. 



II. ASSESSMEKT MBTBOOOLOGY 

A. Assessment of achievement (Parts 1 to IS) 

The assessment methodology in this math class is dominated by sets of math 
probl«ts to be solved. This domination extends to homework (for practice and 
grades) f quizzes and tests. The problem sets are either developed by the 
teacher or are adapted from sets published with the textbook. The teacher 
knows what items reflect intended outcomes of the text and the tests and 
quizzes assess those outccmes and are very ajppropriate. As mentioned above ^ 
oral questioning ccmes into play in this class also. However ^ the teacher 
describes this as more of an instructional strategy than an assessment 
strategy. She seems well aware of its inherent weaknesses^ such as problems 
in obtaining a representative sample of behavior. 

Ttie assessmc^nts consistently require analysis of the component parts of 
problans and inferences as to proper solutions. These aspects of assessment 
match apparent instructional priorities. 

B. Assessment of affect (all 10 items) 

The only two dimensions of affect asse^'Sed are student attention 
(seriousness of purpose in class) and the extent to which the snudent is 
trying (motivation and effort) . These are both assessed via conservation of 



4100e KQ 

35 ''^ 



students during instruction* Inattention most often takes the form of 
inconsiderate behavior while the teacher or another student is talking* The 
offending student is not rebuked or called to attention! ^ut rather becomes 
the focal point of the teacher^s instructional questions* 

Motivation and effort are assessed informally via observation of work 
completion and formally via observation during ^participation grade^ time* 
Students seen as not trying receive low grades for it* 

C, Assessment of ability 

^e teacher is very clear about her intent to measure math achievement* 
Either students can solve the problems or they cannot* she reports that she 
teachers them on those terms. She relies on no other constructs such as 
ability, she says she is held accountable for what the students know and 
don^t knov. 



D* T^xt asaessme its 

Frcm an assessment point of viewf the teacher relied on the textbook for 
daily homework assignments and for sose test items used on tests and quizzes. 
While complete tests accompanied the texts the teacher did not use the 
complete test. Bather she selected items and ideas for items from the 
published tests, she was Very clear in her opinions about item formats. She 
does not like selection*type items (T/^' multiple choices etc,)* She wants 
students to show work. 



III, CRITERIA FOR SELECTING ASSESSMENT METHODS (A-j) 

As with other dimensions of assessments the math teacher has the luxury of 
being able to be very clear about these criteria. An interview revealed that 
the teacher iB clear about the importance of (a) knowing the purpose for 
assessment, and (b) matching tests and intruction* These were the keys in 
developing assessments. The teacher wanted a clear objective index of math 
problem solving ability that either required a reasonable amount of homework 
time or could be administered as a test in a class period or less. Problem 
sets were consciously selected to meet these criteria* 



IV* QUALITY OP ASSESSMENTS (A-C) 

^e assessments are generally of high quality* This is due to the nature 
of the content^ the textbook and accompanying material, and the teacher. 
Algebra is assessable via clear^ straightforward problems. The text provides 
these in assignments and tests. The teacher knows what she wants and selects 
problem sets to get it. 
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The only technical problem noticed was that some of the problem sets may 
be too brief to adequately .sample the domain dependably* The teacher balances 
coverage with the time available to assess. Often available time is very 
brief. 

The teacher reports deriving little assessment information from oral 
questioning. So few questions are asked that she knows coverage for any 
individual is too shallow to be of value. But she sometimes does use 
recollection of responses as an index of attention and effort. 



V. FEEDBACK PBOCBDDitES 

Since observations were done before this descriptive framework was 
devised^ my data are very thin here. Two factors strongly influence the use 
of feedback in this teacher's classroom. Firsts the algebra classes attract 
all (or at least noostly) strong students. A count of class participants 
revealed that they were mostly male and predominantly Asian. 

Observations of student/teacher interaction reveale<3 that the teacher 
relied on oral and written feedback. Kon*verbal feedback was not a factor. 

The oral feedback was used during instruction (in class). I saw very 
little teacher "Student interaction outside of class. It was focused on the 
subject matter covered^ unless a behavior problem arose. However^ even in 
this case^ the feedback was focused on math skills. That feedback took the 
form of a specific question which the offender was called upon to answer. 
Students knew when such a questicxi was being asked and why. 

Written feedback included grades and comments regarding incorrect 
solutions to problem. Correct solutions to similar problems were often used 
as feedback to lead students to understanding. 



VI. DESCRIPTIOK OP TEACHER AND ASSESSMENT 

A. Iteacher^s background 

Tlie teacher has long experience in teaching high school math. Her 
assessment techniques tesult from that experience and no other source. 

B. Teacher's expenditure of time . 

Assessment takes up a large share of this teacher's time**often as much as 
a third of a class period. Because years of development have produced a pool 
of test itens, test planning and development take very little time. Test 
administration and scoring take up most of the assessment time. 
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C# Teacher characteristics 

The teacher presents material as laid out in the text adopted by the 
district at a pace that fits the student group* She has very high standards 
for herself and others but is flexible in how she meets those standards* Her 
entire mode of assessment {show work problems) reflects a desire to ^give 
partial credit*** She has an optimistic set of expectations about her 
students* She knows what tbey need to learn and how she can bet teach it* 

Evidence of the flexible and experimental manner in which she views 
assessment is seen in her ''creative ideas** for assessment* During my 
observations, she administered daily quizzes covering the content at hand* At 
the end of that weekr she announced that the sum of the quiz scores would be 
substituted for the weekly Friday test* She described this as an attenpt to 
disarm test anxiety* Students reacted positively and performed well* Her 
next experiment would be a take*h08te weekly testr*'just like in college*** 
strategy rarely used at the high school* 



VII* T£ACH£R*S PERCEPTIOHS OF STUDENT CHABACTERISTICS 

The teacher has ^n optimistic view of students to match her optimistic 
expectations* in an interview rbout her students^ the most striking comments 
addressed the great variation in student traits she must address* That 
variation in prior achievement and motivation manifests itself across 
individuals within classesr across classes covering the same contents acruss 
levels of content (advanced vs* oasicJ and from year to year* The teacher 
even senses major changes in student traits as the year unfolds* She contends 
that this extreme variation is why she allots 10 to 20 minutes per day for 
individual help for students* 

^e teacher's strongest ccm&ents came in response to questions about 
parental expectations* Those expectations are very unclear because she is 
unable to involve parents in the activities of school* This is very important 
to her and a source of significant frustration* 



VIII » ASSESSMENT POLICY 

This teacher operates independently of any district or other policy with 
regard to assessment* She is uninformed regarding assessment policy and is 
not influenced by it* She knows what assessment is needed and develops needed 
procedures herself* She is aware of and influenced by district specified 
policies regarding content to be covered* She adheres to the adopted text and 
curriculum outline* She also adheres to district policy regarding grade 
reporting require'aents* 

Policies and regulations currently on the books that might bear on the 
issue of classroom assessment in general are neither detailed nor 
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prescriptive* They appear In District Policies and Regulations Manual under 
Teachers-Duties and Responsibilities In the dlstrlct*s job description of the 
classro<M teacher, and in the high school*s Teacher*s Handbook* Policies 
stipulate that assessment of progress will be continuous^ focus on perfomiance 
goals at a^roprlate levels and reported to parents on a regular basis, as 
specified by the principal* Final exams and homework are encouraged^ 
particularly at the secondary level* Grades are to reflect student 
achievement In the subject* 

In factf grading practices represent one area In which the Teacher*s 
Handbook presents detailed and explicit Instructions, ^he meaning of each 
grade Is spelled out* The role of attendance and behavior In grade 
determination Is discussed In detail* Procedures for determining grades are 
enumerated and teachers are urged to review these with students* And grade 
reporting requlr^ents are recommended. 
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PJROFIliE OF MATHEMATICS CASE #1 



I. ASSESSMENT PURPOSES 



A. Diagnosing individual 
student needs 



B* Diagnosing group needs 



C* Assigning grades 



D. Grouping for instruction 
within class 



E* Identifying students for 
special services 



F* Controlling and 
motivating students 



G* Evaluating instruction 



B. Communicating achievement 
expectations 



Uninformed JL Well informed 

Ir re levan t JL ^ levan t 

Useless X_ Useful 

Not used 2_ Used frequently 

Uninformed X_ Well informed 

Irrelevant Re levant 

Useless X_ Useful 

Not used X Used frequently 

Uninformed X_ Hell informed 

Ir re levan t JL. Re levan t 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed _X Well informed 

Ir re levant Re levan t 

useless J£ Useful 

Not used _X Used frequently 

Uninformed Ji Well informed 

Irre levan t _X Re levan*: 

Useless _X Useful 

Not used _X Used frequently 

Uninformed X_ Well informed 

Ir re Xevan t X_ Re levan t 

Useless X_ Useful 

Not used X_ used frequently 

Uninformed X_ Well informed 

Irrelevant X- Relevant 

Useless X_ Useful 

Not used Ji used frequently 

Uninformed 3£_ Well informed 

Ir re levan t 3£_ Re levant 

Useless >L Useful 

Not used X_ Used frequently 



ERIC 



4l00e 



40 



B3 



I* COinmunicating affective 
expectations 



J* Providing test^taking 
experience 



Oninforiaed X Well informed 

Irrelevant X Relevant 

0 se le 88 X Usef u 1 

Not U8ed X Osea frequently 

Uninformed X_ Well informed 

Irrelevant X Be levant 

Use le 88 X Usef u 1 

Not used X Used frequently 



K« Relative importance 
of purposes 



Given *'100 importance points** to distribute 
across the purposes listed below^ how would 
you distribute those points to reflect the 
relative importance of the decisions listed? 



Diagnosing individual needs 
Diagnosing group needs 
Assigning grades 
Grouping for instruction 
Identifying students for 

special services 
Controlling and 

motivating 

Evaluating instruction 
Communicating achievement 

expectations 
Coomunicating affective 

expectations 
Test taking experience 



30 



SO 



10 



100 points 
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II* ASSESSHEKT HETHODOLOCY 
A* Agfleasroent of AchievoDent 



1* Teacher-developed paper and Uninformed X_ Well informed 

pencil tests and quizzes Inappropriate JL Appropriate 

Useless X_ Useful 

Not used Used frequently 

2* Text-«mbedded paper and Uninformed Well informed 

pencil tests and quizzes Inappropriate X_ Appropriate 

Useless x_ ^Jse f u 1 

Not used X_ Used frequently 

3* Performance assessments Uninformed X Well informed 

Inappropriate _X Appropriate 

Use less _X Usef ul 

Not used _X Used frequently 

4* Oral questioning strategies Uninformed X Well informed 

Inappropriate X_ Appropriate 

' Useless X_ useful 

Not used X_ Used frequently 

5* Standardized tests Uninformed X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not useo ,J£ Used frequently 

6* Group assessment Uninformed X Well informed 

methods Inappropriate , _X Appropriate 

Useless , X Useful 

Not used _X Usea frequently 

7* Opinions of other teachers Uninformed X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used Used frequently 



8* Assessment of reasoning Uninformed X_ well informed 

skills Inappropriate Appropriate 

Useless X_ Useful 

Not used X_ Used frequently 



9* Regular assignments 



10* student P«er rating 



11* Student self ratings 



Uninformed Well informed 

Inappropriate 3L Appropriate 

Useless X_ Useful 

Not used ^Jfifid frequently 

Uninformed ^Jt Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used J5_ Used frequently 

Uninformed 2L Well informed 

Inappropri ate X Appropriate 

Useless Ji Useful 

Not used X Used frequently 



12* Proportion of all assessments for all purposes that are of various typ^s 



Teacher-developed paper and 

pencil tests 
Text-embedded paper and 

pencil tests 
Performance assessments 
Oral questions 
Standardized tests 
Opinions of other teachers 
Begular assignments 
Group assessments 
Student Peer ratings 
Student self ratings 



13* Cognitive levels of questions posed in: 



Recall 

Analysis 

Comparison 

Inference 

Evaluaticu 



30 



30 



10 



30 



100% 



Study and Oral Tests and 

DiscussioD^jQuestions Questions Quizzes 
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14* Strategies for integrating 
assessment and 
instruction 



15* Dealing with cheating 



B* Assesgment of ftf feet 

1* Observing individual 
students 



2* Observing group 
Interactions 



3* Using questionnaires 



4* Using interviews (formal 
and informal) 



5* Opinions of other 
teachers 



6* Opinions of other 
students 



Uninformed , X Well informed 

Inappropriate X_ Appropriate 

Useless , X_ Useful 

Hot used X_ Used frequently 

Uninformed ( Not observed) Well informed 

Inappropriate , Appropriate 

Useless , Useful 

Not used , Used frequently 

Uninformed X_ well informed 

Inappropriate X Appr<^riate 

Useless , X Useful 

Not used X_ Used frequently 

Uninformed X Well informed 

Inappropriate X Appr<^riate 

Useless X ^ Useful 

Mot used _X , Usea frequently 

Uninformed (Not observed) Well informed 

Inappropriate Appropriate 

Useless Useful 

Kot used Used frequently 

Uninformed (Not observed) Well informed 

Inappropriate Appropriate 

Useless Z , Useful 

Not used ^ Used frequently 

^informed ( Hot observed) Well informed 

Inappropriate Appr<^riate 

Useless Useful 

Kot used Used frequently 

Uninformed (Not obse rve d) Well informed 

Inappropriate , Appr<^riate 

Useless Useful 

Not Uf ^ Used frequently 
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7* Opinions of parents 



6* Past student records 



Uninformed (Jjot obse rv ^) Well informed 

Inappropriate Appropriate 

Useless Useful 

Not used Used frequently 

Uninformed (tot observed) Well informed 

Inappropriate Appropriate 

Use le ss Usef u 1 

Not usea Used frequently 



9* Checklist of affective characteristics measured: 



Seriousness of purpose 

Hotivation and effort 

Attitude 

Learning style 

Interests 

Values 

Preferences 

Acad<oiic self-concept 

Locus of control 

Anxiety 

Maturity 

Social skills 

Study Fkills 

Other (specify 



Code a 

F ^ formal assessment conducted 
I • informal assessment conducted 



10* Relative importance of affective assessment methods* 

Observing individual 

students 
Observing group 

interactions 
Using questionnaires 
Using interviews 

(formal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Past student records 



100 



100% 



C» Assessment of Ability 

1* Meaning of ability fw teacher 
Valfae of this factor 
for the teacher 



Important 



X Unimportant 
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Measurement of ability Measured formally 

Measured infotinally 
Not measured 



Ingredients considered in assessment of ability^ if measured: 

FACTOR(S) INCLUDED IN ASSESSMENT MEASURED HOW? 

1. 
3. 



2* Check derisions influenced by results (i*e*f change with varying levels of 
ability). 



Instructional objectives 
Instructional strategies 
Grouping for instruction (within class) 
Methods for measuring achiev^ent 
Grading standards 

Students selected for special services 
Other ( specify 



D. Tfext Assessments 

CheclclX&t of assessment cooiponents provided with text 

0) 
H 

IQ 0) 
> W 

< o 

Oral questions for class use 

X X Hoineworic assignments 

, General ass6 .lament guidelines for teachers 

X X Paper and pencil tests (adapted) 

Performance assessments 

Scoring guidelines 

' Quality control guidelines 

_ Other (specify 
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Ill* CRITERIA FOR SELECTING ASSESSMENT METHODS 



A. Results fit purpose Uninformeci X_ Well informed 

Un ii^por tan t X_ Impor tant 

Not used X_ Used frequently 

B# Method matches material Uninformed X_ well informed 

taught Unimportant X_ Important 

Hot used , X used frequently 

C# Ease of development Uninformec X well informed 

Unimportant , X Important 

Not used ^^^^ X Used frequently 

D# Ease of scoring Uninformed X_ well informed 

Unimportant Important 

Not used X^ , i_ Used frequently 

Origin of assessment Uninformed X_ Well informed 

Un impor tan t Impor tant 

Not used _X ; Used frequently 



F* Time r^^quirod to Uninformed X_ well informed 

administer Unimportant X_^ Important 

Not used ,.„ X_ Used frequently 

G* Degree of objectivity Uninformed X_ well informed 

Un impor tant X_ Impor tant 

Not used ^ X Used frequently 



H* Applicability to Uninformed*^ X_ well informed 

measuring thinking skills Uniin>ortant X_ Important 

Not used X_ Used frequently 

I# Effective control of Uninformed X_ well informed 

:;heating Unimportant X Important 

Not used _X Used frequently 
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J. Gelative importance of rriteria 



ResuXts fit purpose 25_ 

Method matches material taught 4Q 

Ease of development 5_ 

Ease of scoring 0 
Origin of assessment 0 
Time required to administer 10 
Degrae of objectivity 10 
Applicability to measuring 
thinking skills 10 

Effective control of cheating 0_ 

100% 
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IV. QUALITY OF ASSESSMENTS 

A* Percent of paper and pencil assessments (teacher -developed or text-embedded) 
having the following characteristics (need not total 100%): 

% 

100 Clear description of assessment specifications 

100 Hatches content of instruction 

Hatches cognitive levels of instrtiction 
Hinimizes time required to gather needed information 

100 Item format matches desired outcome 

100 Iteme clearly written 

Unc ertain Ite^s sattple domain 

100 Scoring procedures planned 

IQO . Scoring criteria written for essays 

100 cl^ar directions 

100 High quality reproduction 

100 Test scheduled to minimise distractions 



B. Percent of performance assessments having the following characteristics: 
(Not used) 
% 

„ Clear description of trait to be measured with levels of 
proficiency atticulated 

Hatches intended outcomes of instruction 

Hinimizei: time required to gather needed information 

Cieer performance criteria 

Students aware of criteria 

Thoughtful exercises yield performance samples 

Exercises sample performance domain 

Performance rating planned 

Besults match information needs 



C. Percent of oral questions having the following characteristics: 
% 

10 Sampling methods cover range of achievement levels of students 
100 Strategies involve everyone 
T>00 Teacher waits for response 
100 Student's response given supportive reaction 
lOQ Questions match cognitive levels of instruction 
0 Written performance records maintained 
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V* JEEDBACK PROCEDURES 

A* For oral and nonverbal feedback 

Percent o£ feedback delivered to students who are: 
% 

9p Strong (vs* weak) 

^0 Correct (vs* incorrect) 

80 Hale (vs* female) 

Percent of feedback having the fcllowing characteristics: 
% 

10 , 0 Delivered in class (vs* out of class) 

100 Oral (vs* nonverbal) 

9 , 0 Public (vs* private) 

100 pair (vs* unfair) 

100 Focused on achievement (vs* affect) 

100 Germane (vs* irrelevant) 

100 Immediate (vs* delayed) 

50 Positive (vs* negative) 



B* For written feedback 

Percent of feedback delivered to students who are: 
% 

90 Strong (vs* weak) 
Var iable Correct (vs* incorrect) 
8 , 0 Male (vs* fem2le) 

Percent of feedback havii^ the following characteristics: 
% 

50 CtMument (vs* symbol) 

50 Positive (vs* negative) 

100 Fair (vs* unfair) 

100 Germane (vs* irrelevant) 

100 Focused on. achievement (vs* affect) 

Uses samples of performance Never X 

as feedback 

Uses public achievement chart Never _X 

as feedback 
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Vlt DESCRIPTION OF TEACHER AND ASSESSMENT 
A* Teacher's background 

1* Teacher experience* number of years: 21 Overall 

21 At grade level 

Un known In schopl 

,, 21. With content 

2* Relative contributions of various sources to teacher's knowledge of assessment 
methodology 

% 

Teacher preparation training 

Inservice training 

Ideas and suggestions of colleagues 

Professional literature 

Teacher's guide to textbooks 

100 Own experience in classroom 
Other (Sepcify ) 



100% 



Bt Teacher's expenditure of time 

1« Proportion of time ^ent in teaching activities 
(No information) 
% 

10 Planning 

20 Teaching (one on one) 

40 Teaching (group) 

30 Assessing (see list below) 

, Other (specify 



.100% 

2* Proportion of time spent in assessment activities (paper and pencilf performance 
assessment, oralf assignments) 
(No information) 
% 

5_ Reviewing and selecting assessments 

10 Developing own assessments 
35 , Administering 
30 Scoring and recording 
20 Providing feedback 
Evaluating quality 



100% 



C* Teacher chaiacteri sties 

Servant of policy 
Curriculum maker delivering 
Role in the classroom and presents X_ required content 
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Bxpectations of Expects a 

professional self Expects little 9reat deal 

Structure needs Rigid X Flexible 

View of high Correctness Degrees of 

quality performance demanded X quality eval. 

Stereotypic view of students None X Expressed often 

Attends to exceptional student Never X_ Frequently 

Sense of performance norms Unclear Very clear 

Orientation to experimentation No risks JL ^^^^ taker 

Orientation to cheating No concern X Major concern 

Amount of cheating None ( Not observed } A great deal 

Value of promptness; importance 

of timely work completion Unimportant X Important 

Interpersonal environment of 

the classroom regarding assessment: 

Cooperative None X Frequent 

Compet it ive None X Frequent 

Attributions for reasons of 
student success/failure: 

50 Due to student 
50 Due %p teacher 
100 « 

fiasis for grading students: 

Sense of ability 

100 Demonstrated achievement 
100« 

Interpretation of assessment: 

Norm*re fere need 
100 Criterion*referenced 
100« 
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VII. TEACHER'S PEBCEPTIONS OF STUDENT CHARACTERISTICS 

A* Ability to learn Low (Hot a factor High 

No variation fo r this Great deal 

Variation ignored teacher ) Addressed 

B* Willingness to learn Low X High 

Ko variation X_ Great deal 

Variation ignored X Addressed 



C# Rate of achieveaent Low X High 

Decreasing X Increasing 

0 . No variation X Great deal 

Variation ignored X Addressed 



D* Maturity Irresponsible X Responsible 

No variation X Great deal 

Variation ignored X Addressed 



Study skills Undeveloped X Developed 

No variation X Great deal 

Variation ignored X Addressed 

Social skills Undeveloped X Developed 

Ua variation X Great deal 

Variation ignored X Addressed 

^ G* Willingness to perforin Reticent X_ Willing 

No variation X_ Great deal 

Variation ignored ' X Addressed 



H* Feedback needs Weak X_ Strong 

No variation X Great deal 

Variation ignored X_ Addressed 

I# Self-assessment skills Undeveloped ,JC Developed 

M6 variation _X Grent deal 

Variation ignored _X Addressed 
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J* Sense of fairness 



K. Beaction to testing 



^* Parental expectations 



Unclear X Clear 

ito variation X Great deal 

Variation ignored X Addressed 

Tranquil X Anxious 

Ko variation X Great deal 

Variation ignored X Addressed 

Unclear _X Clear 

Low X High 

UniJDportant X_ Important 

Ho variation X_ Great deal 

Variation ignored X Addressed 



VIII. ASSESSMEtfT POLICY 
(See attached table) 
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Virit Hi&t^Kii ic L«a influence clasaroon aaadssMnc? 



State 



o It I G r H s 
DLacricc 



o p 



p o L r c V 



Departt&enc 



Coll€gUl 



Poes A standard «xLscT 
Doaa teacher kxvM 
standard? 
Ct Does it Lnpacc 
practice? How? 


A. 


A. yes 

B. yes 
yes 




A. 

c. 


A^ 
B. 
C. 


A. 

C. 




A. yes 

B. yes 
yes 


A. 

B. 

c. 


B. 








A. yes 

B. no 
c. no 


A. 


A. 
B. 


A. 
C. 






yss 
B. ho 

Ci: no 








A. 


A. 


A. yes 

B. no 
c. no 












A. yes 

B* no 
no 






A. 
C. 






A. yes 

B. yes 

c. yes 


A. 
B. 

Ci 


A. 
B. 

c. 


A. 



/ 
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M^^THBMATICS CASE STUDY »2 



Background Information 

Tbe study of the classroom assessment environment of this high school math 
teacher spanned one week and involved observations and interviews near the end of 
the 1985-86 school year* Tbe teacher's class schedule begins at 8:20 am with a 
planning periods followed by two periods of second year algebra and one period of 
senior Ftath* Following lunch, the teacher meets one period of calculus^ a period 
of first year algebra and finishes the day with another senior math class* 

Ttie algebra and calculus classes contain good students in a college preparation 
math sequence* Senior math students are siinply trying to complete one final math 
unit for graduation* This class covers basic math and students are not motivated* 
A vast majority of students are male and about half of the algebra students are of 
oriental heritage* 

The teacher is a veteran of over 30 years of service*-most of which were spent 
at the urban technical high school where he now teaches* As a result of this long 
tenure on the job the teacher holds very strong values about students^ their 
motivation and learning* He also emplc^s a set of assessment and instructional 
procedures that he feels are tried and proven* 

By way of introduction^ the teacher provides a clear and concise portrait of 
many of the key dimensions of his assessment environment in the following 
quotation* This type of message is given to each student in writing at the 
beginning of each term and is discussed in detail* Ttie description varies only 
slightly depending on the course: 

Assignments are handed out on sheets for about 1/2 year at a timer to 
account for absence^ outdoor schools vacation^ etc* 

Ito assignments will be given on Friday as long as we can maintain my 
schedule* 

Ito tests will be given on Friday or Monday if at all possible* 

Grades will come mainly from tests scores and approximately 5 percent 
from daily work* Grades will suffer greatly if daily work is not in 
and on time* Daily work is handed in by leaving it on desk 
sometime during the period or as you leave the class at the end of 
the period* Daily work aay be handed in anytime in a two day tijne 
interval and be acceptable* Each person must correct their own daily 
paper before handing in* Problems from the days lesson are to be put 
on the board every day (except review days)* The first 10 minutes of 
class time is reserved for the students putting these problems on the 
board and if a student cannot do his or her problem for the board 
they may get help frc»n me in this 10 minutes to enable them tc do 
their part* Xf a student does not put up their problem they get a 0 
in the gradebookr more than two of these after the first grading 
period will result in a lowering of the grade* Problems are on the 
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board to enable students to correct their work and answers. No 
student will be required to put more than two problems on the board 
0 in any one day* when I ask for questions on the work, the student 

should ask about any problem you do not agree with the method or the 
answer that is on the board* If you ask for a problem not on the 
board that is assigned you have the responsibility of doing this 
problem on the board within 5 minutes or a 0 can be given. 

0 Grades are <100 to 90)% is an A, (89 to 80)% is a (79 to 65)% is a 

C, (64 to 50)% is a D, belkow 50% is an F on the tests* If daily 
work is in then (100 to 85)% is an A, (84 to 75)% is a B, (74 to 50)% 
is an earned I will also give a C to any student who gets all the 
daily work in, acceptable and on time and has at least a 35% average 
and creates no problems for the class* You can get a D or F if the 

0 daily work is not in* D comes when a student has a passing average 

50% or better and too many missing daily papers* (more than 4) or all 
the daily papers in* F come if below a passing average and daily 
papers missing* f9hen absent 2 or more days you have twice the time 
you are absent to makeup the work missed because of absence* 

0 The first grading period X am lenient and will give a "C" to almost 

anyone with an average of 30% or more unless a B or better is earned 
but daily work missing must be made up before the end of the second 
grade period to receive any grade above a ^* 

The^ first grading period average will not alter the second periods 
0 grade unless it will raise that grade, but daily work will, third 

periods grade is averaged with the fourth periods grade toz the 
senester grade* 

If you are having trouble of any kind please come see ne and let me 
know vhat it is so we can adjust to make it possible for you to keep 
0 up* Just don^t fail by doing nothing* As a teacher I^n here to help 

you to be successful not to fail you or make your life miserable* 
1^11 do almost anything to help you to be successful, let me know 
what your trouble is* It may be me, I hope not but we will try to 
work out the problem if you let me know* i£ we can^t then take the 
problem to the counselors^ then the vice*principal, and etc* 

^ Every student is expected to bring his/her own tools to class 

(pencil, papers book^ etc*) every day* 

All work must be done in pencils wO IRK * 

0 There will be no laughing at any question or student asking a 

question in class* 

Each student should always check me by checking your record kept in 
my gradebook to be sure soy record matches yours at to daily work 
handed in* You should oo it at least at midterm arv^ one week before 
^ grades are to be given for the term so we can work out the difference 

if we do not agree* 

This passage illustrates the focus of this teacher*s priorities for classroom 
assessment* 
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I* ASSESSHEHT PfiOCEDUEBS (A-J) 

Each class period Is structured to provide students with an opportunity to 
receive individual help with their development of math skills* Upon arrival 
in the classroonr each student takes responsibility for placing one hone tiork 
problra on the board. As this is being done any student can ask for help with 
any of the problems and is given individual attention. It is also ccmmon for 
students to tell each other when board work is wrong while it is being written 
on the board and to suggest revisions. Hhen all work is on the boards the 
instructor goes over each naking corrections where needed and discussing 
details as necessary* During this checking process^ each student in the class 
corrects her or his own hCMWork paper before handing it in. Using this 
homework review process dailyr the teacher is able tu very carefully diagnose 
individual student and group needs. 

Hhild assignments are not graded per se (see S^tction V. on Feedback) r they 
must be cmpleted or the final grade will suffer. In this wayr he controls 
and motivates students to do the work and clearly communicates achievement 
expectations. He also relies on assignments and tests (including practice 
tests) to communicate achievement expectations. 



As was reflected in the passage presented in the introduction, grades and 
grading practices tend to drive the entire evaluation system. Students 
receive 3 to 4 tests per grading period and in the teacher's wordsr "must do 
the daily work consciously to score well on tests.* Assignments are for 
practice; tests are for grading. 

He does not use assessment to evaluate instruction. He sees no benefit in 
evaluation, us he regards his instructional methods as tried and proven. 
Besides, he recounts instances early in his career wh^nr due to poor student 
performance^ he revised instruction, retaught material and retested. Student 
performance did not improve, so he gave up on evaluation and revision. 

While the teacher does not intend to use classroom tests as practice for 
the large-scale standardized tests, he does try to use test it^s and formats 
(described below) like those students will take in college. 



II* ASSESSHEKT METHODOLOGY 

A. Assessment of achievement (Part 1 to 15) 

The teacher relies CG^pletely on one and only one method for assessing 
math achievements problem sets which students must solver showing all work. 
These sets make up all homework assignments^ teste ^rd quizzes. Studi^nt 
responses are evaluated in terms of their ability co complete all steis in 
reaching the correct answer. The correct answer itself represents a small 
part of the student^s score for each problem. Partial credit is always 
possible. As suchr all assessments tap student reasoning skills. Traditional 
true/false and multiple-choice items have been rejected by the teacher because 
he does not want to emphasize correct answers only. 



Problems used in daily assignments come from the textbook or are prepared 
by the teacher* All test and quiz items are prepared by the teacher* He is 
an experienced test writer^ having Played a Key role in the past in the 
development of district wide math c s* He keeps a carefully orgranized file 
of past tests r which serve as a bank of itms {or use on £ut*jrc tests* ^ The 
file includes parallel forms of tests for use in case of a need for retesting. 

Student self -evaluation is another key dimension of this classroom 
assessment environment* This takes two forms* Firsts each student must check 
and correct his or her own daily work before handing it in* In addition^ 
K-MVf^Zi and perhaps more importantly^ the teacher consistently a£l;s students 
to eviluate their own understanding during instruction* It students report a 
lack understanding r he reviews the material again* If they do notr he goes 
on* A common alternative to this approach is for a teacher to ask students 
questions during instruction to sample student learning* This teacher asks 
the questions^ but rarely waits for students to respond* He almost invariably 
answers the questions hlmf^lf* 

Issues of teacher judgment rar^^ly play a role in assessments of student 
achievements as in performance asserment* All problems have correct 
solutionfe and those solutions are discovered and carried out properly or they 
are not* The solutions speak for themselves in evaluating achievement* 

Standardni^zed tests do plsy a role in classroott assessment if the district 
happens to have such a test scheduled during a given grading period* But this 
is rare* When it occurs^ the teacher sets aside class time for the test and 
administers the tests according to prescribed instructioTts* He encourages 
students to take it seriously by weighting the test the same as a unit test 
during that period (of which there are typically foe )* 

It is worthy of notar incidentally^ thatr each termr the student has th» 
right to choose one tinit test score to be dropped from the record* This test 
is not figured into the ^rade* The rationale given for this practice is that 
everyone has a bad day* 

^e only mention msde of student peer assessment is the occassional use of 
Algebra XX students to grade Algebra I papers* 

B* Assessment of affect (1 to 10) 

Assessment of affect in this environment is not a coktipl«%x enterprise 
either in terms of the traits measured or the measuranent strategies used* 
Beyond the measurement of student achievements the only other trait measured 
by this teacher is student motivation-^seriousness of purpose* This 
assessment is based almcst completely on the exanination of student completion 
of daily assignments* 

Two dimensions of hcmemrk completion are considered in this measurements 
Firstr as was reflected in the introduction^ students are expected to complete 
the wor!; in a timely manner* Those who do not are judged not to have been 
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trying^ Seconds the teacher seleccB a sample of daily aBfiignments examine 
vecy carefully. £ach week each student received detailed feedback on one 
paper* Baaed on this careful analysiBr the teacher infers whether the student 
is being consciencious. Those who are benefit at grading tijne, especiilly if 
they are on the borderline between grades. 

Two other pieces of evidence contribute to this measurement of seriousness 
of purpose and effort. One is the daily work placed on the board. Students 
who fail to fulfill this resprnsibility (autcmatically) receive a zero in the 
gradebook for that day. Second, the teacher works with students individually 
at the beginning of the class period and uses these informal interactions to 
assess the student's motivation and effort. 

While the measurwent methodology in use in this context seems solid, 
there is one danger that became apparent during observations of .and interviews 
with the teacher.' This person is extremely upset about what he perceivi^^ ^ 
be a major decline in student motivation over the years. This may have left 
him on the verge of being cynical about his students^ wellingness to mrk. 
This cynicism is apparent in interactions with students^ some of which appear 
very aggressive and hos^i e. The danger is that this cynicism will serve as a 
biasing filter through wi«xch the teacher in effect will misinterpret student 
motivation and inappropriately penalize a serious student. I can, oaly lab3l 
this ) danger^ because in factr I saw no specific instamces of such 
misinterpretation inappropriately influencing a grade. 

C. Asse£sme:.^. of ability 

The teache^ does not think about or measure student ability in<$q>endent of 
demonstrated math achievement. He assumes that students assigned to his 
classes by the guidance counselors can do the work. For him, the issue is * 
whether or not th^y are wi lling to do so. * 

O. Text assessments 

Homework problem sets often come from the text in all classes. Tests are 
also ottered by text publishers and occassionally the teacher may adapt a 
problem Cor use on one of his tests. Butr by and large, he makes up his own 
tests . 



II. CRITERIA FOR SELECTING ASSESSMENT HETH(X)S (A TO J) 

The teacher is very clear about assessment purposes, measurement methods 
and the reasons tor using the methods he has adapted. He spends a good deal 
of time developing aeaessments and evaluating student performance. 
Convenience is not an issue. Hia instructional objectives are clear and he 
uses problem sets because they natch his objectives. The origin of 
assessments is important*-tie wants to develop them KimseXf to ensure match. 
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He wants to steasure problem solving (thinking) skill as objectively as 
possible within a reasonable time limit (for hoaiework utid tests)* while the 
assessment method he uses in effect mininiizes the possibility that students 
might cbeatr he doesn^t regard that as an issue* In shortr he measures as he 
does for most of the right reasons* 



IV* gqALXTY OF ASSESSMENTS 

A* Paper and pencil asseasmenta 

nie paper and pencil assessment procedures are of high quality* All 
criteria of good assessment ^pear to be met* Assessments are validr 
reliable understood by students and happen within the resource limits of the 
classroom* 



B* Performance assesaaents 

Regarding performance assessments^ under heading X*A*r X specified that 
this method is not used to measure student achievesaenfc ^ fioweverr under X*&*r 
X also specified that observations and teacher judgments (performance 
assessments) do play a major role in the reasurement of student 
affect~specifically student motivation and effort* These assessments play a 
role in final decisions about student grades* Therefore r like measures of 
achievanentr they must meet certain standards of quality if they are to lead 
to sound decision making* 

Xn this caser most of the standards are He wants students to do 

daily work because he feels this practice will aid learning* Consequently^ in 
his systemr hcnework ccnpletea represents the operational definition of 
motivation* The underlying continuum is th.^.s: those who con^lete the work 
are trying and are motivated; those who do not are not* The exercises are 
hcoiework assignments* There are many of them* Tbcy appear valid* The rating 
procedures are reflected in a checklist of work done so records are carefully 
maintained* Thus^ these procedures are objective and apparently dependable* 
Students know what is eicpected and how perforniance will be measured* This 
appears to be sold performance assessment* 

C* • Oral questions 

This form of assessment is not managed as effectively as are the other 
two* The range of questions asked during instruction is quite narrow and the 
teacher rarely waits for a student response* Further^ no apparent record of 
student performance is kept* 

Fortunately^ howeverr the impact of tht.se problems is minimal because this 
form of assessment plays a mine*, role* Xt does not bear on individual student 
decisions (l*e*r diagnosis or grading) and rarely influences group decisions* 



Questions are often rhetorical and are u&e<1 more as instructional than 
assessment devises. In factr the teacher reports that he does not consider 
this a valid assessment method because often students just will not 
answer^^hether they know the cnswer or not. He sees this an attitude problem 
which interferes with assessment. 

ttote; Evidence cf Overall Quality ; The on#* type of evidence cited most 
often by the teacher as testimony to the apprcqpriateness and quality of his 
assessment is the fact that occasionally a student will return from college 
and thank him for maintaining a d^ttanding classroom assessment environment. 



V. FINBACK raoCEDORES 

A, Oral and nonverbal feedback 

Oral feedback is delivered most f recently during the evaluation of 
boardwork at the beginning of class. As such it is corrective in nature. 
Correct problem solutions receive little attention. Students who make 
mistakes receive the attention. These tend to be weaker students. 
Incidentally this feedback goes most often to males because they represent 
such *^ high percentage of the class. 

Key characteristics of this oral feedback are that It is aggressively 
delivered in class and is quite publicr verbal and clearly focused. When it 
is not clearly focused on d^onatratM workr it contains inferences about 
student motiv. ^,ion and may be unfair. In one notable instance^ a student wbcmi 
the teacher had yet to identify was publicly labeled ^stupid or a liar* based 
on board mrk. While such feedback was very rarer when it occurred it left an 
indelible mark of aggressive cynicism on the addessment environment. 



B, Written feedback 

Written feedback always reflected a careful analysis of student workr 
pointing out problems when necessary^ It too was corrective and tende to go 
to the weak points in student performance. Therefore^ it was more neg ive 
than positive^ but was always highly focused on student math wor^c. In 
addition^ written feedback was delivered in a private manner on student 
paperS"*whether test or assignment. 



VI. THE TEACHER AKI^ ASSESSMENT 

This is a very experienced teacher who has taught himself to assess 
student performance through years of classroom experiences. While colleagues 
may have contributed some to that developments he gives them only minor 
credit. He devotes a great deal of time to assessment. Instruction ir^ay claim 
20 of the class minutes. Much of the rest goes to evaluating board work 
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and providing needed feedback aa well as to providing students with in^class 
practice time during which he can provide help. When quiz and test time iB 
considered toor assessment appears dcstinant. His out of class time is devoted 
almost completely to the careful evaluation of student paper. He needs little 
time for planning and preparation^ as he knows his objMtives inside out and 
has instructional treatments clearly articulated. His time goes to checking 
papers im keeping thorough records and carefully analyzing 10 student papers 
per c3^'s per day. 

In interview^ he describes himself as a very independent professional 
striving for excell'^nce, Boweverr he is doubtful if bis colleagues or student 
are striving for the same goal and that frustrates him* As mentioned 
previously^ he is cynical about student attitudes toward school and teachers 
and attributes the decline in this area to changing family patterns and 
increasing problems at bone* 

£ven sor he is clear about his expectations and standards a,K3 strives to 
help students meet them* Host males could be very successful in math "^if they 
would just work hard at it^"* in his opinion. 



VII, TEACHER'S PERCEPTIONS OF STD0ENT CHARACTERISTICS (A TO h) 

When asked to profile bis perceptions of the characteristics of his 
studentSr this teacher spontaneously provided two completely distinct 
profiles* One described student characteristics averaged across all of his 
classes. That profile appears on the summary profile. It reflects a scmewhat 
Dptimistic, positive view of bis students. They are able to learnr are 
achieving^ etc. Their motivation, maturity^ etc, are samwhat lacking. And 
he reports that there is much variation ir; these traits across students. Many 
of these perception have been discussed above t So these ratings p:. vide some 
evidence of the dependability of the profile of this teacher's classroom 
assessment environment. 

But the second profle reflects perceptions not addressed up to this 
point. That profile reflects the teacher's t^inion of student in senior math 
classes only, Tiiese are students who are assigned to this class to fulfill 
one last math requirement for graduation. At the time of ssy observations^ 
these students were within a tew weeks of graduation. The teacher profiled 
tbese students at the lowest possible end of all scales {ability^ willingness^ 
achievanentr maturity^ etc,) and reported absolutely no variation in these 
negative traits across all students in these classes. 

As we discussed these students it became apparent that they (students in 
tvo of his si;c class' 0 were the cause of the cynical perceptions of the 
student body as a wl ie* In factr he perceives fundamental differences in key 
student traits across different classes, In practice^ however^ his verbal 
interchanges with students^ assessment methods and instructional methods do 
not reflect those differences. All classes and students are treated exactly 
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alllce« Speculation as to what differences in treatntent might be justified are 
beyond the scope of this case reports The key finding here Is that a major 
0 discrepancy In student characteristics Is not reflected In different classroom 

assessment environments across classes^ 



VIII. ASSESSMEtTT POLICY 

As a general rule^ beyond requirements for content to be covered and for 
reporting achievement Information^ this teacher Is unaware of and does not 
consciously adhere to any policies as governing student assessment. He sees 
himself as responsible for devising and using assessment procedures that fit 
his particular context. 

In factf the policies bearing on this Issue are district policies. The 
one exception to this Is the state requlronent that sttidents take a specified 
nunber of units of math. This gives rise to the senior math classes this 
teacher covers. But this policy does not Influence the assessment processes 
per ser which ate the same In senior math as In all other classes. 

There are a number of district policies that could Play seme role In 
determining the nature of the assessment In this classroom. One Is district 
testing policy. This could take up class tiaie and place a pr»lum on 
large*scale standardized testing. In fact^ It rarely does. Another Is 
achievement reporting requirements. Graded are to be reported four times per . 
yeai with sanester grades going Into the permanent record. The teacher 
ccinplles with this policy. 

There Is a policy on the books regarding homework. But the teacher Is 
Influenced by his own standards In this regard. Class site Is a matter of 
policy. But in math^ especially the algebra classes^ the student count Is 
veil below maximums. But even if the classes were full^ the assessment 
process would not change. Policy with regard to attendance holds that 
students must have the qpportunl^ to make up work. This teacher has specific 
procedures in place to allo»; this to happen. And f nally, the district 
specific content to be covered by selecting the text to be used in each 
course. The teacher adheres to the text as the curriculum outline and 
assesses accordingly. 

I was able to uncover no school^ department or colleglal policies that 
spoke to assessment Issues. 
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FROFII4E OF MATHEMATICS CASE #2 



I. ASSESSMENT PURPOSES 



A. Diagnosing individual 
student needs 



B. Diagnosing group needs 



C. Assigning grades 



D* Grouping for instruction 
within class 



£* Identifying students for 
special services 



F. Controlling and 
motivating students 



G. Evaluating instruction 



H. Communicating achievonent 
expectations 



Uninformed Well informed 

I r re le van t Re levant 

Useless X_ Useful 

Not used Used frequently 

Uninformed X_ Well informed 

Irrelevant JL HalAvant 

Useless X_ Useful 

Not used 3L ^Jaed frequently 

Uninformed X Well informed 

Irrelevant Relevant 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed X Well informed 

Irrelevant X_ Relevant 

Useless X_ Useful 

Not used ^ Used frequently 

Uninformed _X Well informed 

Irrelevant _X Relevant 

Use less _X Use f u 1 

Not used ^J£ Used frequently 

Uninformed , X well informed 

I r re levan t X_ ^ levant 

Useless , , X_ Useful 

Hot used X_ Used frequently 

Uninformed X Well informed 

Irrelevant X_ Relevant 

Use le ss X_ Use f u 1 

Not used _X Used frequently 

Uninformed 3L Well informed 

Irrelevant X_ Relevant 

Use^^ss 3£_ Useful 

Not used X_ Use<3 frequently 
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t* Cannunicating affective Uninformed _X Well informed 

expectations Irrelevant X Relevant 

Useless X_ Useful 

Not used _X Used frequently 

J* Providing test-taking Uninformed X_ Well informed 

experience Irrelevant X_ Helevant 

Usele 8s X_ Useful 

Hot used X_ Used frequently 



K* Relative importance Given "100 importance points" to distribute 

of purposes across the purposes listed below, bow would 

you distribute those points to reflect the 
relative importance of the decisions listed? 



Diagnosing individual needs 


20 


Diagnosing group needs 


10 


Assigning grades 


40 


Grouping for instruction 


0 


Identifying students for 




special services 


0 


Controlling and 




motivating 


10 . 


Evaluating instruction 


0 


Comunicating achievement 




expectations 


10 


Communicating affective 




expectations 


0 


Test taking experience 


10 




100 points 
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II. ASSESSHEUT H£TH(H)OLOGY 

A* Assessroent of Achievement 

1* Teacher -developecl paper and 
pencil tests and quizzes 



2. Text-^mbeadea paper and 
pencil tests and quizzes 



3* Performance assessments 



4. Oral questioning strategies 



Uninformed X_ Well informed 

Inappropriate X_ Appropriate 

Useless JL Useful 

Not used ^„ _?L t'sed frequently 

Uninformed , X Well informed 

Inappropriate X_ Appropriate 

Use less JL Useful 

Not used X Used frequently 

Uninformed X Well informed 

Inappropriate _X Appropriate 

Useless , . JC Useful 

Not used _X Used frequently 

Uninformed X Well informed 

Inappropriate , X ^propriate 

Useless X Useful 

Not used X Used frequently 



5* Standardized tests 



6* Group assessment 
methods 



7* Opinions of ether teachers 



Uninformed X_ Well informed 

Inappropriate „ X , Appropriate 

Useleso _X Useful 

Not used X Used frequently 

Uninformed X Well' informed 

Inappropriate X Appropriate 

Useless X , , Useful 

Not used _X ^ Used frequently 

Uninformed x Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Not used X Used frequently 



6* Assessment of reasoning 
skills 



Uninfor&ied 
Inappropriate 
Useless 
Net used 



X 



Well informed 

Appropriate 

Useful 

Used frequently 
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9* Regular assignments 



10* Student peer rating 
If 

11* Student self ratings 



Uninformed Well informed 

I nappropr i ate X_ Appropr iate 

Useless X_ Useful 

Hot used > X Used frequently 

Uninformed X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Hot used X , Used frequently 

Uninformed X Well informed 

Inappropr i ate X_ Appropriate 

Useless X_ Useful 

Hot used X Used frequently 



12* Proportion of all assessments for all i>urpo8es that are of various types 



Teacber-d eve loped paper and 

pencil tests 
Te3ct*embedded paper and 

pencil tests 
Performance assessments 
Oral questions 
Standardized tests 
Opinions of other teachers 
Regular assignments 
Group assessaents 
Sttident peer ratings 
Student self ratings 



SO 



30 



-0- 

o" 



20 



100% 



13* Cognitive levels of questions posed in: 

Study and 
Discussion Questions 

Recall 

Analysis 

Ccmparison 

Inference 100% 
Evaluation 



Oral 
Questions 



100% 



T^^s and 
Quizzes 



100% 
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14* Strategies for integrating 
assessment and 
instruction 



15* Dealing with cheating 



Uninformed ^ X_ Well informed 

Inappropriate , , X_ Appropriate 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed Hot observed Well informed 

Inappropriate , Appropriate 

Useless Useful 

Not used Used frequently 



B# Assessaent of Affect 

1* Observing individual 
students 



2* Observing group 
interactions 



3* Using questionnaires 



4* Using interviews (formal 
and informal) 



5* Opinions of other 
teachers 



6* Opinions of other 
sttidents 



Uninformed , 3C Well informed 

Inappropriate , , X Appropriate 

Useless Useful 

Not used ^ X_ Used frequently 

IJninformed No evidence ^ Well informed 

Inappropriate ^ X Appropriate 

Useless , X Useful 

Mot used Used frequently 

Uninformed No evidence Well informed 

Inappropriate X Appropriate 

Useless X_^ ^^^^^ Useful 

Not used X ^ , , Used frequently 

Uhlnformed X Well informed 

Inapprcjpriate X Appropriate 

Use le ss X Usef u 1 

Not used X ^ Used frequently 

Uninformed , Nft , evidence , Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used JC Used frequently 

Itoiinformed N9 eviplence Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used X , Used frequently 
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7* Opinions of parents 



6* Past student records 



Uninformed 3£ WeZl informed 

Inappropriate 3£ Appropriate 

Useless X Useful 

Not used _X Used frequently 

Uninformed X_ WeZl informed 

Inappropriate 3£_ impropriate 

Useless X_ Useful 

Hot used X Used frequently 



9* Checklist of affective characteristics measured: 



Seriousness of purpose 

Motivation and effort 

Attitude 

Learning s^le 

Interests 

Values 

Preferences 

Acadenic self-concept 

Locus of control 

Anxiety 

Maturity 

Social skills 

Study skills 

Other (specify 



Codes 

F ■ fornLal assessment conducted 
I ■ informal assessment conducted 



10* Relative Importance of affective assessment methodst 

Observing individual 

stuffents 
Observing group 

interactions 
Osing questionnaires 
Using interviews 

(formal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Past student records 



100% 



C* Assessment of Ability 

1* Meaning of ability for teacher 
Value of this factor 
for the teacher 



Important X_ Unimportant 
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Measurement of ability Measure-i formally 

Measured informally 

Kot measure*". X 

Ingredients considered in assessment of ability* if measured: 

FACTOR(S) ItlCLUDED IH ASSESSMENT MEASURED HOW? 

!• 
2. 

4* 

5. 



2* Check decisions influenced by results (i*e*f change with varying levels of 
ability)* 

, , Instructional objectives 

Instructional strategies 

, , Grouping for instruction (within class) 

, , , Methods for measuring achievonent 

, , , Grading standards 

Students selected for special services 

ether {specify ) 



D* Text Assessments 

Checklist of assessment ccmponents provided with text 

r-i 
H 



> m 
< D 



Oral questions for class use 
Bimework assignments 

General as&essnent guidelines for teachers 

Paper and pencil tests 

PerfOcmance assessments 

Scoring guidelines 

quality control guidelines 

Other {specify 



Ill* CRITERIA FOR SELECTING ASSESSMBKT METHODS 

A* Results fit purpose Uninformea JL Well informed 

Unimportant X_ Important 

Not used X_ Used frequently 



Method matches material Uninformed X_ weil informed 

taught Oninportant X_ Important 

Not used X_ Used frequently 



C# Ease of development Uninformed 3L Well informed 

Unimpor tant _X Impor tant 

Not used JC Used frequently 

D# Ease of scoring Uninformed ^ X_ well informed 

Unimportant _X Important 

Not used _X Used frequently 



E* Origin of assessment Uninformed 3C_ Well informed 

Ite important , X_ Important 

Not used ^sed frequently 



F* Time required to Uninformed ^ X_ Well informed 

administer Unimportant X_ Important 

Not used , , _^ X Used frequently 



64 Degree of objectivity iteinformed ^ X_ well informed 

Unimportant X_ Impor tant 

Not used X_ Used frequently 

H* Applicability to Uninformed X_ well informed 

jneasuring thinking skills Unimportant X_ Important 

Not used X Used frequently 

I* Effective control of Uninformed X_ well informed 

cheating Unimportant X_ ^ Important 

Not used X Used frequently 
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j« Relative importance of criteria 



Results tit purpose 10.. 

Method matches material taught 30 

Ease of development 0_ 

Base of scoring 0 

Origin of assessment 10 

Time required to administer 10 

De9ree of object' vity 10 
Applicability to measuring 

thinking skills 30 

Effective control of cheating 0_ 

100% 



^3 97 



• 



IV. QUALITY OF ASSESSHEHTS 



A* Percent of Paper and Pencil agsesBinents (teacher-developed or text-embedded) 
having the following characteristics (need not total 100%): 



% 
100 

'loo" 

100 
100 
100 
100 
100 



100 
100 
100 



Clear description of assessment specifications 

Hatches content of instruction 

Hatches cognitive levels of instruction 

Hiniaises tine required to gather needed information 

Itent forniat natches desired outcome 

Items clearly written 

Itents sanrple domain 

Scoring procedures planned 

Scoring criteria written for essays 

Clear directions 

High quality reproduction 

Test scheduled to minimise distractions 



B* Percent of Performance assesgmentfl * having the following characteristics: 



% 

Unclear 
100 



100 
100 
100 
100 
100 
100 
100 



Clear description of trait to be measured with levels of 
proficiency articulated 
Hatches intended outcomes of instruction 
Minimises time required to gather needed information 
Clear performance criteria 
Students aware of criteria 

Thoughtful exercises yield performance samples 
Exercises sample performance domain 
Performance rating planned 
Besults match infomation needs 



*Used for affective assessment cnly 
C* Percent of oral questions having the following characteristics: 



Unc ertain 
0 



50 



100 



Sampling methods cover range of achievement levels of students 

Strategies involve everyone 

Teacher waits for response 

Student's response given supportive reaction 

Questions match cognitive levels of instruction 

Writttfn performance records maintained 
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V* FEEDBACK PflOCEDURES 

A« For oral and nonverbal feedback 

Percept of feedback delivered to students who are: 
% 

75 Strong (vs* weak) 

25 Correct (vs* Incorrect) 

75 Hale (vs* f^ale) (only because males dominate the enrollment) 

Percent of feedback having the following characteristics: 
% 

100 Delivered in class (vs* out of class) 

90 Oral (vs* nonverbal) 

70 Public (vs* private) 

95 Pair (vs* unfair) 

loo Focused on acbiev«&ent (vs* affect) 

100 Germane (vs* irrelevant) 

100 Immediate (vs* delayed) 

50 positive (vs* negative) 



B* For written feedback 

Percent of feedback delivered to students who are: 
% 

25 Strong (vs* weak) 

25 Correct (vs* incorrect) 

75 Male (vs* female) 

Percent of feedback having the following characteristics; 
% 

loo 2oimDent (vs* symbol) 

25 Positive (vs* negative) 

loo Fair (vs* unfair) 

100 Germane (vs* irrelevant) 

100 Focused on achievement (vs* affect) 

Uses samples of performance Never X Frequently 

as feedback 



Uses public acbievanent chart Never Jt Frequently 

as feedback 
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n* DESCRIPTION OF TEACHER AND ASS£SSH£NT 

A* Teacher's background 

1* Teacher experience* number of years: 



33 Overall 

33 At grade level 

33 In school 



33 With content 



2* Relative contributions of various sources to teacher's knowledge of assessment 
methodology 



Teacher preparation training 

Ineervice training 

Ideas and suggestions of colleagues 

Professional literature 

Teacher^s guide to textbooks 

Own experience in classroom 



10 



90 



100% 



B* Teacher^s expenditure of time 
1* Proportion of time spent in teaching activities 
% 



10 



40 



40 



100% 



Planning 

Teaching {one on one) 

Teaching (group) 

Assessing {see list below) 

Other (specifyi Supervising student Practice 



2* Proportion of time spent in assessment activities (paper and pencil* performance 
assessment* oral* assignments) 



Reviewing and selecting assessments 

Developing own assessments 

Administering 

Scoring and recording 

Providing feedback 

Evaluating quality 



10 



20 



60 



10 



100% 



C* Teacher characteristics 



Role in the classroom 



Curriculum maker 
and presenter 



Servant of policy 
delivering 
required content 
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Expectations of Expects a 

professional self Expects little X_ great deal 

Structure needs Rigid _X Flexible 

View of high Correctness Degrees of 

quality performance demanded X_ quality eval# 

Stereotypic view of students Hone X_ Expressed often 

Attends to exceptional student ^eve^ X_ Frequently 

Sense of performance norms Unclear X_ Very clear 

Orientation to experimentation No ris/.s ^Jt Risk taker 

Orientation to cheating No concern _X Major concern 

Amount of cheating iJone U nknow n A great deal 

value of promptness^ imE>ortanoe 

of timely work completion Unimportant X Important 

Interpersonal environaent of 

the classroom regarding assessment: 

Cooperative NOnc X_ Frequent 

C«cpetitive Hone _X Frequent 

Attributions for reasons of 
student success/failure: 

100 Due to student 

Due to teacher 

100% 

fiasis for grading students; 



100 
100% 



Sense of ability 
Demonstrated achievement 



Interpretation of assessment; 



Korm*referenced 



100 Criterion-referenced 
100% 
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VII. TEACHER*S PERCEPTIONS OP STUDENT CHARACTERISTICS 
A* Ability to learn 



Low 

No variation 
Variation ignored 



(Not a factor 

f or this _ 

teach e r) ^ 



High 

Great deal 
Addressed 



B* Willingness to learn 



C* Rate of achiev^ent 



D* Maturity 



E. Study st^ills 



P* Social skills 



G* Willingness to perform 



n* Peedback needs 



I* Self-assessment skills 



Low X High 

NO variation „,. X_ Great deal 

Variation ignored X Addressed 

LOW X High 

Decreasing X Increasing 

No variation „,. „,. 3^ Great deal 

Variation ignored JC^ Addressed 

Irresponsible _X Responsible 

No variation „, X ,, Great deal 

Variation ignored X Addressed 

Undeveloped x Developed 

No variation _^ 3L Great deal 

Variation ignored X Addressed 

undeveloped 3^ Developed 

No variation X^ Great deal 

Variation ignored X_ Addressed 

Reticent X Willing 

No variation , X „ Great deal 

Variation ignored X Addressed 

Weak X Strong 

N<> variation 3£ Great deal 

Variation ignored _X Addressed 

Undeveloped x Developed 

No variation X Great deal 

Variation ignored X Addressed 
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J* Sense of fairness 



K« Reaction to testing 



L« Parental eKpecta^^ions 



Uhclear Ho info Clear 

No variation Great deal 

Variation ignored Addressed 

Tranqui 1 X Anxious 

Ho variation )£_ , Great deal 

Variation ignored ^ X , Addressed 

Urv ^ear X Clear 

Low ^^X High 

Unimportant X_ IinporUnt 

Ho variation X_ , Great deal 

Variation ignored X Addressed 



VIII. ASSBSSMEHT POLICY 
(See attached table) 
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V1 11* Wliat 



cidfi lnfluen< 
Federal 



1^ 



classroom iiseelinant? 

State 



ORIGINS or POLICY 
District School 



CoLLeqiaiL 



h* Does a standard exLet? 
B* Doett t^achor know 

standard? 
C* Does it itnp^ct 

practice? How? 


A* 
B* 
C, 


yes 

a* ycS 

yes 




A. 
B 

C. 


A, 
B, 


A. 
B, 

c. 




A. yes 

B * yes 
yes 


A. 

c. 


A* 
B* 
C, 








yes 

B* nf\ 

c. no 


B, 

c. 


A. 

c. 


A. 
B* 
C, 






A- yes 

^* no 
no 








A. 


A, 


yes 
^* no 
no 












A. yes 

B*, no 
c. no 






A, 
C, 






A. yes 

B. yes 
c, yes 


A. 
B< 

C. 


A< 
B< 

C, 


A, 



/ 
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BIOIX)Gy CASE STUDY #1 



Background Information 

Tbis biology teacher is on the staff of a four year high school located in 
a large urban school district* The physical plant has all the characteristics 
of an olderr urban high school* The tallr imposing structure is located on a 
busy intersection in the heart of a stable middle and mrking class 
neighborhood* 

This observation was conducted over a three week period of time during 
Aprilr 1986* Discussions and interviews with the teacher took place during 
the days the observations were conducted* 

The teacher has been teaching high school biology for approximately 15 
years* He has arranged his schedule so that his four sections of General 
Biology meet in the morning* General Biology meets one of the science 
re^iranents for graduation but students who are not inclined co science or 
h^'ve a weak academic record may take other science courses instead* 
Counselors are a significant factor in deciding who takes which level of 
science* Classes average around 26 students per section* A few Asian and 
black students are visible^ but probably not in representative numbers to the 
number of ethnic minorities in the school* Boys and girls appear to be nearly 
equally represented across the 4 sections* 

After a quick lunchr he aoves directly into the Experiental Biology classf 
a course which he designed himself* It is an elective course which was 
originally intended to engage the student in scientific research* The course 
has evolvted to emphasise intense scientific study of an experiential nature 
rather than comprehensive research* He purposely steers away from calling it 
''Advanced BioLogyr** although the course is intenticmally geared for the 
advanced student who has a genuine interest in biology* Eleven students^ 
mostly boysr are enrolled in Experiential Biology this year* 

The biology rooms were designed by the teacher soine years ago when the 
science wing was remodeled* It reflects his desire to provide multi-purpose 
spaces for students to pursue independent and group work* It is spacious and 
inviting* There are always students in the area^ whether the teacher is in 
class or not* The main room consists of a classroom laboratory with the 
standard tables^ chairs and long counters and an adjoining but separate 
soninar zoom* Around the parameters are small cubicles for independent 
research and a room for animal study* 



I* ASSESSMENT PQBPOSES 

niis teacher*s purpose for assessment is directly related to his long term 
goal for the studentsr whether they take General Biolx>gy or Experiential 
Biology* 
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"I want to affect an attitude toward science on the part of these 
students* I am not interested in isolated pieces of information but rather 
students* learning that science is discovery^ it takes long term involvement 
and it*s experiential* Science is an attitude and a camnitment « Science has 
those pec^le who fit the norm and do science the prescribed way* Host science 
is done that way* Science also has the *odd balls,* those who come to science 
through creative, non-traditional means* I tend to favor the odd balls* 

"I am interested in process and inquiry and the way students go about 
solving their problems^ the questions they ask and their seriousness of 
purpose* " 



His purpose for assessment follows his own mandate to "do science with my 
students*" E>oing science means investigating phencsaena with an openr 
questioning approach, conducting eicperimentsr drawing hypotheses, making 
generalizations and connecting concepts and ideas about the natural world* It 
takes a willingness to stick with problems, probing^ following leads^ being 
systematic yet ideosyncratic in one*s pursuit* fie consciously shys away from 
language that describes his assessment purposes in terms of "diagnosis^ 
grouping^ motivating" therefore^ it is consistently difficult to determine how 
well informed he is regarding certain practices* It is safe^ however^ to 
describe his purposes and practices as consistent and unified^ attributed to a 
strong philosophy of science and teaching* fie chooses his words carefully and 
cautiously to describe his purposes* fie is primarily interested in student 
achievement but cosmiitmentr seriousness of purpose^ and willingness to 
participate are intimately connected to doing science^ and his class is set up 
in that manner* 



A* Diagnosing individual student needs 

I^is teacher assesses informally through observation of students primarily 
for the purposes of instruction^ not assessment* The structure of the class^ 
particularly when they are working in a laboratory moder is designed to 
provide students with an opportunity to receive individual help with their 
pr :jects* It is evident that he Lh constantly watching students^ listening to 
their questions and interactions* In several instances he adjusted the lesson 
through instructional methods such as pacing^ reviewing or informal 
suggestions during lab time* Twice he noted some confusion on a worksheet in 
his first period class and incorporated these problems into his opening 
instructions and remarks in the renaining classes* 

There is no evidence that he does anything special to size up students at 
the beginning of the year* He makes yearly adjustments in the curriculum 
based upon his own professional work in science and what works with students 
over time* Student interests are somewhat of a factor in his changes and he 
captures these through informal discussions* fie notes that certain 
laboratories such as the fruit fly experiment of reproduction are difficult 
and confusing but "classic" science and he would rather adjust the pace of 
instruction and the means of arriving at the result rather than eliminate the 
laboratory because of its difficulty* "When students finish such a laboratory 
they have a real feeling of acccoiplishment* They should* They have done scone 
real science* " 



It 1b up to th3 student to apply him or herself to this curriculum* The 
conBlBtency of the student* s grade over the TOurs^ of the year (only a few 
students shift more than one grade designation during the year) indicates that 
froot the teacher*s point of view students reveal **what kind of student they 
are** early in the year based upon his criteria (see Grading I.c*)* He talks 
about **A** studentp and **C** students in such a way that I include he judges a 
student's capability in very broad terms but he says emphaticallyf **A11 
students can get an A if they want*** He makes few adjustments based upon an 
infot'mal determination of student needs and the diagnosing he does do is not 
for assessment purposes but rather instructional planning* 

C* Assigning Qradea 

The teacher shows great impatience with questions regarding assigning 
grades for assessment purposes* **Grades are not ny major tool of teaching* 
They don't get in my way cf doing science* I don*t value grades as much as 
the personal impact I have on students about science* Being wrong on grades 
is not as critical as how a kid experiences the class. Grading is necessary 
only because of the bureaucratic requirements of the system* It doesn*t often 
have anything to do with getting scmething out of the class. I try to reduce 
the damage^ the negative effects of grades. When a student asks about grades^ 
I change the subject to* 'Why are you here?*** 

While he assesses the quality of the homework on a regular basiSf students 
only receive a grade once a term* There are no tests in either course (See 
II*A*1 for explanation)* The gradebook consists of a set of period markSf 
checks and pluses for hcmeworkf and attendance which somehow translate into a 
term grade* Class participation is a critical factor ia the final grade but 
there is no evidence that records on participationf except for attendance^ are 
kept* The laboratory notebook is a sunmative activity and includes a record 
of all activities* Student notebooks are assessed acooiiing to a criteria 
check sheet at the end of each term which is inserted into the notebook* (See 
II*A*3 Cor criteria*) Students are given the following grading policy in the 
General filology course at the beginning of the year: 

A" 

All homework completed; no more than three late assignments* CanpJeted 
assignments must demonstrate full comprehension of material. Laboratory 
notebook completed? must Include full record of all activities? data 
recoxir collection and analysis; charts^ graphs and tables as required; 
well organized and written; scientific drawings accurate and properly 
levied; and conclusions which demonstrate full comprehension of 
laboratory investigations* Class participation must be industrious; 
structured and individual work periods must be used productively for 
investigations pertinent to the subject* Students are expected to 
participate fully in all class discussions. 

B- 

All homework completed; no mor«% than six late assignments. Cc^pleted 
assignments must demonstrate general understanding of material* 
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Laboratory notebook completed f must include satisfactory record of all 
activities f data records collection and analysis f charts^ graphs and 
tables as required; sufficiently organized to allow reader to follow 
investigation records; answers and conclusions should be satisfactorily 
structured; illustrations that are complete and correctly labeled; and 
conclusions which demonstrate general comprehension of laboratory 
investigations* 

Class participati<^ must be industrious; structured and individual work 
periods must be used productively for investigations pertinent to the 
subject. Students are expected to participate in class discussions. 
Minimal distractions from classroom activities. 

O 

Satisfactory completion of three^'fourths of homework assignments r not more 
than nine of which are late. Fair understanding of material/concepts from 
assigned reading and laboratory investigations. Notebook must reflect 
participation in class. Inadequate completion of all learning activities. 

0- 

Minimal participation in class and completion of course requirements. 
Satisfactory coi^letion of two-thirds of homework assignments. Classroom 
behavior may be a factor in determining this grade. 

F» 

Major projects not completed; hcttework unsatisfactory or inccAiplete; does 
not demonstrate understanding of course concepts. 

Ttie Experiential Biology class is given a similar policy at the beginning 
of the year. 

course work includes the following: 

1. Formal notebook. Full summary of experience based upon each 
student*s escperience. £ach student is responsible for documenting 
all activities/e^^riments conducted during the grading period. 

2. Homework. Readings and assignments. 

3. Seminars. Pre sen tat ions r participation and write-up. 

4. Field trips. Participation* recordkeeping. 

5. Laboratory. Investigations^ recordkeeping and formal write-up. 

6. Attitude. Contributions to clasSr sharing in activities* individual 
and team participation. 

7. General notebook. Informal record; collection of information from 
handoutSr field trip notes; laboratory investigations, personal notes. 

8^ Special activities. Independent projects^ guest speakers^ special 
projects, etc. 
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Grades are established according tc the following criteria: 
A- 

Rill participation in all areas; complete understanding of concepts; 
assignments contpleted on time; demonstration of independent study skills 
and initiative* Class benefits from the participation of these students* 

B" 

Most of the above criteria met, Mi\Bt have contributed to the positive 
atioosphere of the class* May have some late assignments, but all must be 
completed at the conclusion of the grading period* 

O 

Poor participation* Some assignments missing* Lack of demonstrated 
understanding of concepts* 

D- 

Poor participation* Assignments late and/or missing* Lack of 
danonstrated understanding of concepts* Behavior severely disruptive* 

P» 

No meeting basic requirements of the class* 



D* Grouping for instruction within the class 

The teacher does not group for instruction* He believes that students 
should be allowed to seek out their own partners for oollaboration and 
supports unless it interferes with the learning of others* He allows 
considerable freedom for students to learn in their own style hence r 9couping 
is casual and peer generated for the most* Students frequently work together 
on homeworkf class work and laboratory experiments* 



E, Identifying students for special services 

There is no evidence to indicate whether the teacher does this or not* 
counselors have the responsibility for placement and biology is just one of 
several course students can take to fill the science requirement* 



F* Controlling and motivating students 

There is no evidence that this teachers uses assessment in order to 
control student behavior but he does use a grade in order to conmiunicate to a 
student regarding her/his motivation , and be spells out what class 
participation means in the grading policy* Sarar a senior, is an example of 
such practice* Sara "knows a lot about science* She is going on to study 
science but she has a lax attitude* Although her work was 'B* workr I gave 
her a *C^ last term because I wanted to send her and her parents a message: 
there is more to being a biologist than she is exhibiting*" Sara or her 
parentsr however^ do not challenge or question the grade* The teacher assumes 
that she understands the message that he is sending* He indicated that he had 
talked with her about her lax attitude sometime during the term* 
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He vanta students to be siotivatea to do sciencer not motivated to obtain a 
grade* He giv^s feedback on all regular assignments inunediately so that 
students know how they are doing in learning science* itone of these are 
graded* Rather # he assesses student participation^ cooonitment and involvement 
in the labs as factors indicating a motivation to learn* He does this in all 
five periods through observation and interaction* He keeps no special records 
on this^ api^rently storing the information in his head* 

6* Evaluating instruction (see also I* A* Diagnosing individual Needs*) 

I observed the teacher modifying his Instruction several times based upon 
his observations of the students in the laboratory activity and bis assessment 
of the homework which he checks immediately upon student entry into class* 
Evaluating instruction is a priority for this teacher but he relies upon his 
usual methods of assessing student performance^observation and interaction 
with students* 



H* Cdmnunicating achievanent expectations (See I*C* for some overlap) 

This teacher has high expectations of students as he does hitnself* His 
om seriousness of purpose is conveyed in his intense manner during class* It 
appears that students are affected by this posture* 

At the beginning of the year he hands out his grading policy, which 
consists of A one page criteria and which indicates his clearest statement of 
expectations {see I*C for description)* Hanework is profuse and regular* 
Several students conoaented informally that the class **is alot of work*** 

George is an example of his concern about standards* George is a senior 
star basketball itudent ^o transferred into the school this year* The school 
scrambled around to accommodate him* The teacher was told that George was a 
very good student in science, but the teacher concluded otherwise* **George 
appears to have been moved along because of his athletic ability and his 
social skills* He handles people with icqphistication* I was somewhat lenient 
during basketball season but last term I gave him an **F** to communicate to him 
that he no longer could slide by on his performance*** if grades are ai^ 
indicator of coonunicating expectations, this teacher applies rather high 
standards* At least one-fourth of his students received D*s and F*s each term 
during this year* 

I* Cowmunicatinq affective e3g>ftctations 

Because doing science is intrinsically connected to a conceptualisation of 
science he attends to student coamitmentr and attitude through participation 
which is defined on his grbUing policy (see 1* C for description)* Thus^ for 
this teacher there is no difference between academic expectations and 
affective exipectations* At the beginning of the year he tells students that 
they have to figure out for themselves the answer to the issue of motivation! 
*lmat am I going to do to to demonstrate my participation?** He observes 
students in labs and questions thm after but the only written records he 
keeps on participation is an attendance record* 
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The teacher*8 refusal to test (see II*A. 1) as damaging to the students* 
as learners and makers of science iB one indication of his concern for student 
self-concept. His system of gradebook notation (see I. C.) which includes 
period marks l:or n^^itive attendance rather than negative absence is ^ simple 
exan^le of how he guards against low academic self^oncept. 



II. ASSESSMENT HETBODOLOGY 

A. Assftsament of achiftv^nrnt 

1. Teacher -developed paper and pencil tests 

Three or four years into teaching the teacher asked himself^ "Why am I 
testing?** Be had used tests which accompanied the textbook or sometimes 
prepared his own. He concluded that testing was not connected to the main 
purpose of his teaching which was to engender a science experience for each 
student. Using tests for grading purposes was particularly defeating for many 
students. For a certain kind of student, te&^ were, in fact, damaging. He 
wanted students to be able to freely participate in the course activities and 
he wanted to be able to look out for that. "With *A' students you know they 
know by the quality of the assignments and the nature and level of the 
interactions with me and each other. You don't need to test. With the 
others^ tests are damaging.** 

Inf ^itmCI discussions with several students pointed out that they liked the 
fact that tests were not a part of the course design* One senior said, "Just 
because you get a grade of *C' on a test does not mean that you haven't 
learned alct. Sometimes it's just the opposite*" 

To assess, therefore^ whether this teacher is informed or uninformed 
regarding paper and pencil tests, text*embedded tests and guizses and even 
performance tests was difficult because he categorically rejects these devices 
as inconsistent with bis philosophy of science and his purposes for teaching. 

3. Performance assessments 

Students are primarily judged upon the basis of their perfortnance in both 
the General Biology and Experiential Biology classes* The teacher relies upon 
student products in the form of homework and th^^ laboratory notebook. 
Observation and interaction of students defines his judgment of the class 
participation factor but no written records except for attendance are kept on 
this critical area. 

This teacher's grading criteria (See I.C. for full description) set the 
minimal standards for each graJe equivalent and are spelled out in terms of 
amount and completeness of homework and laboratory experiments. Criterion for 
discerning levels of class participation is also indicated (See II. A. 9* 
Regular Assignments for furtht^r description). Notebooks are the summative 
experience for each term and the teacher lists the following criteria on a 
sheet wh^ch he inserts into the notebook in General Biology. He indicates the 



'eRJC " 



terra grade on this form* Space is allowed for written ccfmnents on each of 
these items: neatness } copipleteness; in order; hypothesis/conclusions; 
graphs/charts; data observations; drawings* class participation is also 
listed here* 

A survey of only a small sample of student notebooks indicated that **A** 
students were nuch inore fluent in writing than the **D** or *F** students* Not 
only were the notebooks of failing students less complete and orderly^ there 
was an obvious lack of attention to thoughtful inquiry^ interests ^nd 
inqufsitiveness* They were much less expressive* The teacher noted that his 
informal assessments during class and lab time in the form of questions 
pointed up those students tfbo mre understanding science conceptually but were 
not able to write expressively^ boweverr there was usually a consistency in 
performance in the notebook work ai^d in the laboratory /class setting* Whether 
students understand the criteria or have been instructed in how to improve 
their performance in this area is unclear* 

4* Oral questioning strategies 

Oral questioning plays a major role in his daily instructio*'- and 
assessment of progress* The teacher also ilistinguisbes high performing 
students from low performing students primarily in their ability to generate 
hypotheses /conclusions and questions/concepts* 

He usually responds to student questions with a question* His usual 
cement isr ***** And what else?** Host significant is the obvious wait time he 
gave students to answer* If there is a confusion on the part of the student 
or a fumbling for wordsr be rephrases the question* While he might spend most 
of class time moving around the laboratory intently responding to student 
problems with st^gestionsr help often ccmes in the form of questions of 
recallr caaparision or analysis* 

He demonstrates considerable skill in asking frequent and germane 
questions but he admits with a smile that he had no name for what he doesr 
although questions are central to his style* He indicates that he is familiar 
with a few time honored principles such backtracking when a question is too 
difficult and avoiding embarrassing questions which put students down* 

5* Standardized tests 

niere are no standardized tests administered in the science department* 
One can only infer tzcm the teacher's position on paper and pencil tests that 
he would strongly object to a trend in this area* 

6* Group assessment methods 

These are not used* Hhile students are allowed and often encouraged by 
the nature of the activity *^ work together and assist one another r the 
efforts of each person is assessed in the form of hdrework and the laboratory 
notebook* The teacher considers a student's willingness to work with others 
as a factor in class participation but in the end it is the quality of the 
laboratory notebook which forms the basis for the judgment of individual merit* 
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7* Opinions of other teachers 

This teacher spends most of his time preparing for class or meeting with 
students and rarely takes time to socialize during the day, Once^ during an 
observation two other science teachers came in rather hurriedly explaining 
that nominations for the science award for next year had to go In 
ijnmediately. He gave his opinion without hesitation and his colleagues 
tacitly agreed. They appeared to have agreement about who the "outst'Miding* 
students were. The fact that he does not test and does not care whether his 
colleagues know is an important indication of his independence. Whether he 
consults with other teachers about student achievement is unknown, 

8, Assessment of reasoning skills 

Assessment of reasoning skills is a central part of what this teacher 
does. Reasoning skills are defined by the ability to generate hypotheses, 
draw conclusions^ fom questions and draw together ideas and concepts. In 
factf he indicates that it is the ability to discern concepts and generate 
questions which differentiate the level student froa the *C* level student 
in general biology. The student will be operating more like a scientist 
while the *C* student may be having more of a nature studies escperience, but 
he considers the differing experiences both valid in the context of his 
class. Experiential Biology students should be able to apply reasoning skills 
to serious scientific problems and project, 

9, Regular assignments 

All homework assignments are checked daily for thoroughness! completeness 
and compreher^sion «3uring the first two minutes of entry to class. In that 
wayf the teacher knows immediately where there are problems in understanding 
so that he can clear them up immediately. He notes whether they are using the 
teKt, following instructions or *just giving any response,* 

Students are responsible for numerous activities around the laboratory 
experience which all becone part of the notebook ^ the heart of the science 
class. Bow a student worked during lab would be mentally noted as class 
participation through teacher's observations and interactions. Homework and 
laboratory activities are both considered regular assignments and it is the 
student*s responsibility to include all the work assigned in class^ ani 
hooework in the notebook, 

11, Student self ratings 

These are not used. If a student feels a grade has been unfair^ he or she 
may ask for reconsideration. Based upon the teacher's own description of the 
process^ what ensues is a dialogue in which the teacher makes his case for his 
standards and the student does the sane. He has been known to change a grade 
if the student can make herAis case but more often it has been a student 
whose academic self perception is skewed. In such an instance ^ the teacher 
holds firm^ and these challenges are very rare, 

12, Proportion of all assessments 

Assessment of reasoning skills included in oral and regular assignments. 



14* Strategies £oc integrating assessment and instruction 

The ^ain way the teacher integrates assessment and instruction is through 
his questioning strategies* He questions students continually^ trying to get 
them to stretch their thinking and use their learning from previous 
activities* He &lso comments orally on hcntework and student progress in the 
laboratory activity* He does this both individually and with the entire 
group* Students are regularly encouraged to come into class on their free 
time to catch up and complete the work* 

(See IXA* 9 Itegular Assignments for discussion*) 

IS* Dealing with cheating 

Student cheating is not a particular concern for the teacher* He includes 
enough variety in labs from year-to-year so that a student who decides to 
cheat can make a gross mistake* "Students who art 'getting it' are usually 
consistent in their work* Participation and commitment cannot be 
misrepresented*" Occasionally it has happened that a student cheats by 
copying and if he suspects he'll set a trap with an assignment that is new or 
different* Then^ he^ll orally question the learning* If the student has a 
perfect paper and no cognition when interacting ^ then he knows there is 
cheating* "I listen closely to what they say in class*" 



B* Assessment of affect 

1* Observing individual students* 

The teacher relies upon his observations and talking with a student to 
determine her/his class participation* Despite the interactive nature of the 
class and the many opportunities for connecting with students during class 
time the teacher still says that the biggest obstacle is "not knowing all my 
students all the time*" 

He looks for a variety of indicators of participation^ and he often uses 
the terms "seriousness of purpose" and "attitude" to convey the fuller meaning 
of this construct* The level of industriousnessr whether the individual 
student works productively on the subject at hand and to what degree a student 
participates in class are Indicators of class participation* If a student is 
not actively participating in class discussion he will make allowances for 
this if he believes the student is conscientiously doing her/his work* In the 
case of a Vietnamese student in the Experiential fiiology class who was not 
actively interacting with his peers in a laboratory assignments the teacher 
mentioned that he looks for other indicators of involvement such as 
attendances level of concentration on task and the level ot interaction he has 
alone with him* Since conceptual understanding is related to doing science 
the teacher believes it is his job to attend to as many different ways for a 
student to demonstrate conceptual understanding as possible* Participationr 
therefore^ appears to be important because it ensures that the teacher will be 
able to assess conceptual understanding more easily^ however s it remains an 
illusive construct* What is lacking here is an understanding of how students 
comprehend and interpret his criteria* 
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2* Observing group interaction (See II* B* 1* for overlap) 

Students vork together on certain labs but are free to choose their 
partners* He nakes changes in seating or groups only if thev interfer with 
the learning of others* In the case of a lesson with the purpose to review 
the process of cell division by ms^osis and mitosis students were able to 
choose between watching the film selected for class viewing or moving to the 
adjacent seminar rocm to review their texts and complete the lab sheet on 
their own or in small groups* It appears that how a student works with 
othersr how on task they are able to remain in a laboratory situation are 
factors which affect the assessment of participation* It is unclear bow well 
defined these areas are for the students* 

3* Using questionnaires 

Itiis teacher would not use questionnaires* 

4* Using interviews 

Itiere is not enough information about the teacher's informal conversations 
with students* Formal interviewing would not likely be used* 

5* Opinions of other teachers 

There is no information that this teacher seeks out or is interested in 
the opinions of other teachers* Given his philosophy^ one would infer that 
this does not occur* 

7 Opinions of parents 

Parent opinion is not actively solicited nor do parents interfer or 
involve themselves in any of his assessment decisions* The teacher has rarely 
had a parent call to question a grade or judgment he has made about a 
student* He views this as endemic to high school life* 

At the appropriate week of the term the teacher sends hone the notices of 
students who are failing or have failed a term* He does this using the school 
forck* He calls attention to absences frcm classr missing homework assignments 
as they affect whether or not the student is participating in the class* 

8* Past student records 

In the case of ''probl^ students'* he has checked past records to gain an 
understanding of the student when his or her behavior has been problematic* 
Jtm, a senior in Experiential Biology, is a case in point* 

Since September Jim had been a disruptive force in the class and one of 
the reasons that the teacher believed the class was not doing truly advanced 
work* "He's the limit to my resources* I have checked on his file and found 
that he did some weird things in junior highf so he has a record to testing 
the limits* I bave the impression that he is a kid who is tightly wrapped; 
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any minute he could go flying o££» But he is smart and clever* He is never 
quite uo blatant that I have had to take action* I do not know why I have 
kept biiH here — perhaps because I have not felt clear about what to do with 
him* But it is not job to try to mental work on students** 

In the third week of April the teacher had Jia r^oved from class* 
"This is the first tiine I have ever gone to a counselor and saiu, *I don*t 
have the documentation on this student* I just don*t want bim in iny class 
anymore* He*s not participating** I always provide documentation of student 
behavior* The counselors know that when I ask for a student to be removed 
tzom the class that I have dealt with it and exhausted all avenues* If I were 
challenged I am on thin ground with this one but because I rarely remove kids 
I can by-pass the process this time* He*8 getting D*s but I am keeping kids 
who are failing so I would have had trouble if I had to justify this solely on 
the basis of academic work* 

*Af ter seeing his counselor be came back and asked why he was dropped «nd 
I saidr *you were not participating* Vou don*t need this class for 
graduation** Jim retorted^ *But I need it for myself** tetually he needed it 
for his parents* His parents wanted him to have it and that finally became 
evident* I then set up an appointment with him^ bis counselor and me but he 
didn*t show nor have his parents called** 

10* Belative importance 

The nature of the laboratory experience and the choice of student learning 
methods does not lend to factoring out these methods* 



C* Assessment of ability 

1* Meaning of ability 

Bor this teacberr ability lAay mean full ccmprehension of material as 
evidenced by conceptual attainment demonstrated through verbal and written 
skills* Ability per se does not seem to be of major importance to this 
teacher* Willingness to participate and seriousness of purpose would affect 
whether a student was able to *do science** 

The teacher consciously avoids the word "ability* to describe his 
students* He believes all students are capable of getting A*s in his course 
and he admits that he has a bard time understanding bow students can settle 
for less* He recognizes that high school students have many demands upon 
cheir attention* He doesn*t expect all students to have the same enthusiasm 
for science but be prides himself on getting most of the students interested 
in some unit of study at some time during the term* *A* students are knowl^ by 
their performance and their continuous interest* Truly advanced students such 
as those who take Experiental Biology are known as "those whom you can 
interest in anything** On a few occasions when he referred to his *A* 
students and bis *C* studetitsr he implied a sense of a capability to 
conceptualize and critically assess the science e^erience* Just how much he 
believed this to be developmental or innate ronains unclear* 
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2. Check deciaions 

One of the problems this teacher encountered this year is that his 
Escperiental Biology class vas not truly **advanced** by his definition. Their 
interest^ commitment and attitude had consequencea for his instructional 
objectives in that the kind of activities he would have planned as he had in 
the past are just not possible with this group. The ability for a student to 
sustain interest may be related to the environment or the effect of certain 
personalities on the group such as Jim (see sect II. B.8 for a description) 
for when Jim was absent he believed that the productivity of the class changed 
dramatically. In former years the Experiential Biology class produced a film 
in cCHijunction with the Northwest Film Study center. This year's group is not 
**capable** of that because of failure in seriousness of purpose and attitude. 



D. Text assessments 

This teacher uses the text for some hcnework assignments. OSiere is no 
information available that he draws from the text for oral questions for class 
use. Because he rejected tests^ I did not do an analysis of test questions or 
guidelines. 



III. CRITERIA FDR SELECTING ASSESSMENT METHODS ifHH) 

Criteria for selecting assessments were difficult to d^lscern and were not 
brought out in the interview. It is questionable whether many of these 
criteria are even a consideration for him in terms of his teaching framework. 
His assessment methodology consists of observation^ interaction during classr 
and review of written assignments. It is fixed by long practice and seems not 
subject to review on his part. 

Everything be does Aust fit his purpose for teaching science as this is 
the single most important criteria he uses for selecting his methods. The fact 
that be uses a criteria so that bis assignments can be translated into a grade 
is secondary. His methods do match the material taught as do the 
applicability to measuring thinking skills. The origin of the assessments are 
all his own as are the required activities. He would probably not consider 
using any outside means of as^sessment. Similarly there is no data as to 
whether he considers ease of developmentr scoring and time a factor in how he 
assesses assignments. 



IV. QOAUTY OF ASSESSMENTS 

A. paper and pencil Assessments 

nie teacher uses no tests. Hcnework and laboratory assignments are 
considered regular assignments which are teacher devised for the most part. 
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He asseBses these with a variety of means , from a simple check/plus systan on 
the homework to written cciuaentB and oral feedback on lab aBsignments* These 
are con'^idered instructional devises rather than paper and pencil assessments* 



B* Performance assessments 

Performance assessment is the chief method by which be measures student 
achievement* Observations and teacher judgments do play a major role in the 
assessment of affect**specifically student participation as the indicator of 
motivation and seriousness of purpose* These assessments determine the final 
term grade and he specifies the standards of quality in his grading policy* 

There is a clear description of the standard in his grading policy ano he 
lists the criteria by which the notebooks are judged* Homework received a 
plus for good workr a check for acceptable workf an ^X^ if it is not completed 
and a slash mark if it is late* There are many homework assignments and they 
appear valid* Records are carefully kept* Attendance is duly noted* Class 
participation is not recorded* Performance samples are not used because be 
believes that stifles creativity* it is difficult to discern whether students 
are fully aware of the criteria and whether their grades would improve if the 
teacher provided good sanples of performance and took more time to ccsmmunicate 
expectations to students* The number of student failing grades (D*8 and F*s) 
is problematic to me* 

C* Oral questions 

As noted in XX*4 the teacher manages bis questioning strategies 
effectively* The range of questions during instruction are quite broad and 
while the teacher style is quite fast pacedf he does manage sufficient wait 
time* He uses questions as the chief form of assessment during lab and class 
Instruction but he keeps no records of student activity in this area* 



V* FEEnSAOC PROCEDURES 

A* Oral &nd nonverbal feedback 

Oral feedback is delivered most frequently on an individual basis during 
laboratory time or before and after class* It is usually in the form of a 
question or eicplanation regarding a student difficulty in understanding the 
content or the activity* it is rarely negative* He communicates positive 
feedback through nonverbal meansr usually with a smile, certainly with his 
attention to those who seek it* 

The evidciice from observation confirms that the teacher makes no 
differentiation in his interactions with students as to t^ether they are 
strong/weak students or correct/incorrect in their responses or male/female* 
H^ attends to whomever asks and manages to get around to all who seek him as 
well as others whom he simply checks on* 
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ftk^ atJDoephere of the clasQ is best characterized as one where students 
are respected as^ individuals who are both capable and interesting people* The 
teacher is both intense yet relaxed^ always zeaOy with a quick smile and a 
recognition of a student's humor* In terms of individual differences^ he 
sayst "I try to keep blinders on* Occasionally it is hard to do as with a 
student who came in with a mohawk style hair cut* Eventually I had to ranove 
him," 

His rule iB never to discuss students in front of others and he prefers to 
discuss performance or grades after class or aside from the group* It appears 
that he restricts his classroom feedback to achievement and to those factors 
that indicate level of participation in class discussions and laboratories* 



B* Written Feedback 

Only a small sample of student notebooks were available for analysis* 
Homework assignments were studied over a week's period but the evidence simply 
suggests that written coMents are rather sparce and that he treats strong and 
weak students the same* He indicated in interview that "'A* students actually 
don't need the feedback as much as the *C* student" because they have ^gotten 
it*" He prefers to be positive rather than negative in his symbols and 
coranents and he likes to attend to misunderstandings immediately* In factt 
everything that he does is immediate to the mcment* This is consistent in 
both the written and oral feedback* 

Uses samples of performance as feedback*** 

He does not like to use saiples of performance as feedbacks either in the 
form of former student work or in terms of his own wrk* He believes that 
this can be lljaiting to the ingenuity and creativity of the students* I 
conclude from the sufficient number of low grades (one-^fourth of his classes) 
that this could be strategy for improving student performance* 



VI* D£SCRimOH OF TEACHER AND ASSESSHEHT 

B* Teacher's expenditure of time 

1* Proportion of time spent in teaching activities 

The teacher indicates that the majority of his out"Of-class time is spent 
in planning* He is constantly running around the schools gathering material 
and equipment for class. One day every two weeks he travels to Eugene where 
he continues his own research in genetics at the University of Oregon* He 
believes that being a good science educator requires that teachers engage in 
curriculum development through their own activity in their field* 
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C. Teacher characteriatica 

Attributions for reasons of student auccesa/failure. 
Theae figures are inferred from the data available* 



VII. TEACHER'S PERCEPTION OP STUDENT CHARACTERISTICS 

This teacher views students as capable r responsible and interesting 
pecqple. He does not stereotype students. While variations cannot be ignored, 
he would probably choose to consider differences as a human relations issue 
rather than a curricular one. He pointed out where problems in such areas as 
maturity, stu6y skills and willingness to learn affect performance and 
achievaient. He does not ^iew these general biology students as much 
different frcm other groups he has taught in the past. The student 
characteristics in the Experiential Biology class this year^ however^ had 
affected the depth of 9tudy and the level of projects in which the students 
were able to be engaged. 



VIII. ORIGINS OF POLICY 

As a general rule^ beyond requirements for reporting achievement 
information and meeting attendance requirements^ this teacher is either 
unaware or does not consciously adhere to any school or district policies as 
governing student assessment. 

He gives minimal ccmpliance to all policies and procedures which affect 
his teaching. He finally submitted objectives for his Experiential Biology 
class to the district when it came to his attention that there was a district 
wide curriculum guide. He pays no attention to itr however, because he 
believes that those objectives are simply minimum expectations which he is 
going beyond. 

^e fact that he doesn't give tests and is not sure whether or not his 
colleagues know is an indication that if there is a school or department 
policy regarding such practices it is enforced rather loosely or arbitrarily. 
He finally wrote up his grading policy when it came to his attention via a 
student that he should have one in writing. He is a very independent teacher 
who may infer that his reputation as a fine teacher allows him some leeway in 
terms of compliance to certain policies. In terms of content to be taughtr it 
appears that he goes well beyond usual standards. 
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PROFILE OF BIOLOGY CASE #1 



I* ASSESSHBKT PURPOSES 



A* Diagnosing individual 
student needs 



B* Diagnosing group needs 



C* Assigning grades 



D* Grouping for instruction 
within class 



Uninformed 3C_ Well informed 

Irrelevant 3C_ Relevant 

Useless 3C_ Useful 

Not used ^^^^ frequently 

Dninforaed 3C_ Wtell informed 

Irrelevant 3C_ Relevant 

Useless Useful 

Not used X Used frequently 

Uninformed X_ , Well informed 

Irrelevant Relevant 

Useless _X ^ Useful 

Not used , X , Used frequently 

Uninformed X Hell informed 

Xrre levant X Re levant 

Useless X , Useful 

Not used X Used frequently 



£* Identifying students for 
special services 



Uhinformed 
Irrelevant 
Useless 
Not used 



No info 

X 

No info 
NO info 



Well informed 

Relevant 

Useful 

Used frequently 



F* Controlling and 
motivating students 



G* Evaluating instruction 



H* Oonmunicating achievement 
eicpec tat ions 



Uninformed X_ well informed 

Irrelevant X_ ^ Relevant 

Useless X_ , Useful 

Not used X Used frequently 

Uninformed 3^ Well informed 

Irrelevant X_ Re levant 

Useless X_ Useful 

Not used JL frequently 

Uhinformed 3C_ Well informed 

Irre levant X_ Re levant 

Useless X_ Useful 

Not used . 3C Used frequently 
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I* Oomnunicating affective 
expectations 



tftiinforroed X Well informed 

Irrelevant 3L Relevant 

Useless X_ Useful 

Not used X Used frequently 



J* Providing test-tak j 
es^rience 



Uninformed N/A 

Irrelevant ^/k 

Useless 

Not used X 



ffell informed 

Relevant 

Useful 

Used frequently 



A* Itelative importance Given *100 importance points** to distribute 

of purposes across the purposes listed belDWf how would 

ycu distribute those points to reflect the 
relative importance of the decisions listed? 



Diagnosing individual needs 15 

Diagnosing group needs 10 , 

Assigning grades 

Grouping for instruction , 
Identifying students for 

special services 

Controlling and 

motivating 

Evaluating instruction 15 
Cowminicating achievement 

ejq?ec tat ions 35 
Conaunicating affective 

expectations 25 

Test taking e^rienoe 

100 points 
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II* ASS£SSM£HT HBTHODOLOGY 
1^ A* Assessment of Achievwent 

1. Tteacher-develcped paper and Uninformed tto Inf o Well Informed 

pencil tests and quizzes Inappropriate X Appropriate 

Useless X_ Useful 

Not used X Used frequently 

2. Text-embedded paper and Uninformed h o in fo Well informed 

pencil tests and quizzes Inappropriate X /appropriate 

Useless X Useful 

Not used X Used frequently 

0 

3. Performance assessments Uninformed X Well informed 

Inappropriate _^ Appropriate 

Useless _^ X_ Useful 

Not used JC^ Used frequently 



4. Oral questioning strategies Uninformed X Well informed 

Inappropriate x_ Appropriate 

Useless 3C^ Useful 

Not used , x Used frequently 

5. standardized tests Uninformed N/A ^ Well informed 

Inappropriate _X Appropriate 

Useless X , Useful 

Not used X Used frequently 



6. Group assessment tJhinformed N/A ' Well informed 

methods Inappropriate x^ , Appropriate 

Useless X_ Useful 

Not used X , Used frequently 

7. <^inions of other teachers Uninformed X Well informed 

Inappropriate ^ X Appropriate 

Useless ^ 3C^ , Useful 

Not used X , , Used frequently 

8. Assessment of reasoning Uninformed X_ Well informed 

skills Inappropriate JC^ Appropriate 

Useless TL^ Useful 

Not used X_ Used frequently 
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9, Regular assignments Uninforaied , JL Woll informed 

Inappropriate ^JL Appropriate 

Useless _ , _^ )C_ Useful 

Hot used 3L Used frequently 

10, Student peer rating Uninfori&ed N O info ., Well informed 

Inappropriate _^ J£ Kppropriate 

Useless , ,. X , Useful 

Ifot used _ _ „ Used frequently 

11, Student self ratings Uninformed . „.tto.ln,fp , informed 

Inaroropriate „ .JL „ Appropriate 

Useless „ , _^ X , , Useful 

Hot used X Used frequently 

12, Proportion of all assessnents for all purposes that are of various types 

Tie acber -developed paper and 

pencil tests 

Tttxt*emJMdded paper and 

pencil tests 

Performance assessments 25 

Oral questions 25 

Standardized tests , 

Opinions of other teachers , 

Itegular assignments , , 50 , 

Group assessments , 

Student peer ratings , 

Student self ratings , 

100% 



13* Cognitive levels of questions posed ini 



Study and Oral Tests and 

Diflcusflicn Questions Questions Quizzes 



Becall 

Analysis 

Comparison 

Inference 

Evaluation 



30t 

lot 

20t 
20t 
20t 



20% 
30% 
20% 
30% 
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14* Strategies tot integrating 
assessment and 
instruction 



Uninformed 
Inappropriate 
Useless 
Not used 



X_ Well informed 

X_ Appropriate 

X_ Useful 

X Used frequently 



15* Dealing with cheating 



Uninforwed X_ 

Inappropriate , X_ 

Useless X_ 

Not used X 



Well informed 

Ac>propriate 

useful 

Used frequently 



B* Assessment o£ Affect 



1* Observing individual 
students 



2* Observing group 
interactions 



Uninformed X Well informed 

Inappropriate Appropriate 

Useless X_ useful 

Not used X_ Used frequently 

uninformed ., tto inf o WeU informed 

Inappropriate X ApprcHpriate 

Useless X_ useful 

Not used X Used frequently 



3* using questionnaires 



Uninformed 

Inappropriate 
Useless 
Not used 



N/A 

x_ 

X 



Well informed 

Appropriate 

useful 

used frequently 



4* Using interviews {formal 
and informal) 



5* Opinions of other 
teachers 



6* Opinions of other 
students 



uninformed „ ., tto int o well informed 

Inappropriate X_ ApprcHpriate 

Useless , , X useful 

Not used ., tto in fo Used frequently 

^informed N^A WeU informed 

Inappropriate _^ X_ Appropriate 

Useless X_ Useful 

Not used _X Used frequently 

Uhinforaed N/A Well informed 

Inappropriate , X Appropriate 

Useless X Useful 

Not used X Used frequently 
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7» Opinions of parents 



84 Past student records 



Uninformed X Well informed 

Inappropriate JC Appropriate 

Useless X useful 

Not used _X Used frequently 

Uninformed 3C_ Well informed 

Inappropriate x_ Appropriate 

Useless X Useful 

Not used X Used frequently 



9* Checklist of affective characteristics measuredt 



Seriousness of purpose 

Motivation and effort 

Attitude 

Learning style 

Interests 

Values 

Preferences 

Academic self-concept 

Locus of control 

Anxiety 

Haturi^ 

Social skills 

Study akills 

Other (specify 



Zode t 

F « formal assessment conducted 
I ■ informal assessment conducted 



10* Relative importance of affective assessment methods: 

^Observing individual 

students 
^Observing groug? 

interactions 
Using qiiestionnaires 
Using interviews 

(formal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Past student records 



fiO 



27 



10 



100% 



*The nature of laboratory experience and the student choice of learning method does 
not lend to factoring out these methods* 
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C. Aflsessment of Ability 



1* Meaning of ability for teacher 
Value of this factor 
for the teacher 

Measurement of ability 



Important X Unimportant 



Measured formally 
Measured informally 
Hot measured 



Ingredients considered in assessment of ability^ if measured: 

FACrOR(S} IHCLUOED IH ASSESSMENT MEASURED HOW? 



Ability is not a factor separate from science achievement* 



1. 
2* 
3* 
4* 
5. 



2* Check decisions influenced by results {i*e*r change with varying levels of 
ability}* 

Instructional objectives 

Instructional strategies 

Grouping for instruction (within class) 

Methods for measuring achievement 

Grading standards 

Students selected for special services 

Other (specify ) 



0* Text Asse^gments 



Checklist of assessment cookponents provided with text 



us 

5 



10 
D 



Ho in fo 

_X X 



No info 
X 



, No info 
Ho info 



No i nfo 



Oral questions for class use 
Bomewrk assignments 

General assessment guidelines for teachers 

Paper and pencil tests 

Ferfornkance assessments 

Scoring guidelines 

Quality control guidelines 

Other (specify 
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Ill* CRITERIA FOR SELECTIHG ASSBSSNEHT METHODS 

A* Results fit purpose Uninformed JL Well informed 

Uniropor tant X_ Impor tant 

Not used X, Used frequently 

B* Method matches material Uninformed JL informed 

taught Oniroportant X_ Important 

Not used X_ Used frequently 

C# Ease of development Uninformed H O iq fo Wtell informed 

XJniropa: tant H o in fo Impor tant 

Not used N o in fo Used frequently 

D* Base of scoring Uninformed N o in f o Well informed 

Onimpor tan t N o in fo Impor tan t 

Not used SipJUtffl fsed frequently 

E* Origin of assessment Uninformed X Well informed 

Unimportant X_ Important 

Not used ,,,, X Used frequently 

F* Time required to Uninformed X Well informed 

administer UniJBportant X Important 

Not used X_ Used frequently 

6* Degree of objectivity Uninformed X weXl informed 

Onimpor tant X_ Impor tant 

Not used X Used frequently 

J^plicability to Uninformed JL Well inforired 

measuring thinking skills Unimportant JL Important 

Not used X_ Used frequently 

I# Effective control of Uninformed X_ well informed 

cheating Unimpor tant X Impor twt 

Not used X Used frequently 
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J 

J. Relative importance of criteria 



Results fit purpose 40 _ 
Method matches material taught 15 

Ease of development 

Ease of scoring 

Origin of assessment 5 

Time required to administer 5_ 

Degree of objectivity 5_ 

/4>Plicability to measuring 
thinking skills 30 

Effective control of cheating 

100% 
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IV. QUALITSr OP ASSESSHEKIS 

A* Petcent of paper and Pencil assesBments (teacher-developed or text-embedded) 
having tbe following characteristics (need n9t total 100%) : 

% 

„ Clear description of assessment specifications 
„ Hatches content of instruction 

Hatches cognitive levels of instruction 

Hinisizes tine required to gather needed information 

Itett foraat matches desired outcome 
„ ItemB clearly written 

Items sample domain 
„ Scoring procedures planned 
,. Scoring criteria written for essays 
Clear directions 

High quality reproduction 
,. Test scheduled to minimize distractions 

B. Percent of &erformance assessments having the following characteristics: 
% 

100 Clear description of trait to be measured with levels of 

proficiency articulated 
100 Hatches intended outcomes of instruction 

Minimises time required to gather needed information 
Clear performance criteria 
Students aware of criteria 
thoughtful exercises yield performance samples 
exercises sample performance domain 
Performance rating planned 
Results match information needs 



C* Percent of oral Questions having the following characteristics: 



Sas^ling methods cover range of achievanent levels of students 

Strategies involve everyone 

lecher waits for response 

Student*s response given supportive reaction 

Questions match cognitive levels of instruction 

Written performance records maintained 
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• 


V. FEEDBACK PBOCEDUBES 




• 


A. For oral and nonverbal feedback 

Percent of feedback delivered to students who are: 




• 


t 

50 Strong (vs. weak) 
50 Correct (v8* Incorrect) 
, 50 Male (vs. female) 




• 
• 


Percent of feedback having the following characteristics: 
See explanation 

t 

75 Delivered in class (vs. out of class) 
100 Oral (vs. nonverbal) 

50 Public (vs. private) 
100 Fair (vs* unfair) 

70 Focused on achievwent (vs. affect) 
100 Gemane (vs. irrelevant) 
100 Zmediate (vs. delayed) 

90 Positive (V8* neqative) 




• 


&. For written feedback 

Percent of feedback delivered to students who arei 
See explanation 




• 


% 

Unpleay Strong (vs. weak) 
Unclear Correct (vs. incorrect) 
^.Oj, Male (vs. finale) 




• 
• 


Percent of feedback having the fallowing characteristics: 
% 

50 Comient (vs. symbol) 

75 Positive (vs. nf*gative) 
100 Fair (vs. unfair) 
100 Germane (vs* irrelevant) 

70 Focused on achievement (vs. affect) 






Uses samples of performance Never _X 

as feedback ^ 


_ Frequently 


• 


Uses public achievement chart Never X 
as feedback 


Frequently 


r o 
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VI. DESCRIPTION OF TBACBEK AND ASS£SSM£HT 
A* Teacher's background 

1* Teacher experience^ number of years: 15+ Overall 

15+ At grade level 

U nknown In school 

15+ With content 

2* Relative contributions of various sources to teacher^s knowledge of assessment 
methodology 

% 

5 Teacher preparation training 



No info Inservice training 

Mb, i n f o Ideas and suggestions of colleagues 

|_ Professional literature 

, , , Teacher's guide to textbooks 
Own experience in classro<M 

100% 



B* Teacher's expenditure of time 

1* Proportion of time spent in teaching activities 
See explanation 

% 

30 Planning 

Teaching {one on one) 

30 Teaching (group) 

10 Assessing (see list below) 

Other (specify 

100% 



2* Proportion of time spent in assessment activities (p^per and pencils performance 
assessment^ oral« assignments) 

% 

3 , 0 Iteviewing and selecting assessments* 
30 Developing own assessments* 
Administering 
Scoring and recording 
30 Providing feedback 

1, 9 , Evaluating quality 

100% 

*As assignments 

C* Teacher characteristics 

Servant of policy 
Curriculum maker delivering 
Role in the clasaroom and presenter _X required content 
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Bxpectatlons of 
professional self 

Structure needs 

View of hl<|h 
quality performance 

Stereotypic view of students 

Attends to exceptional student 

Sense of perfonoance norms 

Orientation to exp«rjjnentation 

Orientation to cheating 

Amount of cheating 

Value of promptness; Importance 
of timely work conpleticxi 



Bxpects a 

Expects little X_ great deal 

Rigid ^ Flexible 

Correctness Degrees of 

demanded X_ quality eval. 

None _X Expressed often 

Hever 2£ Frequently 

Unclear JE Very clear 

No risks ^^^^ taker 

No concern _X „„„ Major concern 

Wone X A great deal 



Unimportant X_ Important 

Interpersonal environment of 

the classroom regarding assessment: 

cooperative llone .,.,„ X_ Frequent 

Competitive llone X .„ Frequent 



Attributions for reasons of 
student success/failuret 
See explanation 

70 Due to student 
30 Due to teacher 



100% 



Basis for grading students: 



100 
100% 



Sense of ability 
D^onstrated achievement 



Interpretation of assessment: 



100 
100% 



Horm^referenced 

Cr iter i<Mi*ref erenced 
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VII. TEACHER'S PERCEPTIONS OF STUDENT CHABACTERISTICS 

A. Ability to learn Low X_ High 

Ho variation X Great deal 

Variation ignored ^J£ Addressed 

B. Willingness to learn Low X High 

No variation X Great deal 

Variation ignored X Addressed 

C. Rate of achievement Low X_ High 

Decreasing , X Increasing 

No variation X Great deal 

Variation ignored X Addressed 

D. Maturity Irresponsible X_ Responsible 

Ho variation X Great deal 

Variation ignored X Addressed 

E. Study skills Undeveloped X Developed 

Ho variation X^ Great deal 

Variation ignored ,„ Jt Addressed 

F. Social skills Undeveloped X Developed 

Ho variation X Great deal 

Variation ignored _X Addressed 

G. Willingness to perform Reticent ^Jt Willing 

Ho variation X Great deal 

Variation ignored X_ Addressed 

H. Feedback needs Weak X_ Strong 

Ho variation X Great deal 

Variation ignored 3£ Addressed 

I. Self -assessment skills Undeveloped ^J£ Developed 

Ho variation X Great deal 

Variation ignored X Addressed 

J* Sense of fairness Unclear U nknow n Clear 

No variation Great deal 

Variation ignored Addressed 
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K. Reaction to testing !l?tanquil X_ Anxious 

No variation , VA Great deal 

Variation ignored h /h Addressed 

L. Parental expectations Unclear Ho info Clear 

Low No _i,nfQ High 

Unimportant X Important 

Ko variation t to , inf o Great deal 

variation ignorea , Ho inf o Addressed 



VIII. ASSBSSHEKT POLICY 
{See attached table) 
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VIII* Whi»:Wolici«a infliMH 



Si: ate 



O tt I G I H S 
Dtstrici: 



0 F 



P O t I C Y 

School 



DeimEtmeni: 



k4 
O 



O 

o 



0^ 



A. Does a standard exist? 

B. Does teadter ki>ow 
standard? 

C. Does it in^ct 
practice? How? 


A* no 
n/a 
n/a 


A* yes 
yes 
yes 




A, no 

B, n/a 
c* n/a 


no 

n/a 

n/a 


A- no 

B. n/a 
c- n/a 




A- yes 
B- yes 

Teacher follows 

guidelines 


A, yes 
B- yes 

Teacher follow^ 

guidelines 


A- no 
B* n/a 
n/a 








A*, no info 
B- no Info 
no xnfo 


no info 
B^ no info 
no info 


A< no 
B- n/a 
n/a 


A- no 
n/a 
n/a 






A- yes 
B. yes 
no info 








A- no info 
fi- no info 
no info 


A, yes 

yes 

Teacher gives 
guidelines 


A' no info 
no info 
^* no info 













A, yes 

B. yes 

Teacher adheres 
to reporting 
guidelines 






A, no 
B^ n/a 
n/a 






A* yes 

B. yes 

Ct Teacher nteets 
standards 


A,, no info 
D, no info 
c, no info 


A< no info 
B< no info 
c, no info 


A, no info 

B, no info 
no info 
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BIOLOGY CASE STUDY #2 



Background Infonnation 

This biology teacher is on the staff of a four Year high school located in 
a predihOninantlY working class neighborhood where few students continue on to 
college* This observation was conducted over a three*^ek period near the end 
of the 1985-86 school Year* 

The teacher has been teaching high school science for seventeen Years* 
She began as a student teacher in this particular school and has remained a 
constant figure in ti^e biologY courses ever since* Her schedule consists of 
four classes of General Biology and one section of Mvanced Biology* There 
are seven periods in the school dayr with one being designated for stucients to 
consult with teachers and make-up assignments or tests* 

Mvanced Biology is ar. lictive course which is described by a former 
student as having the same context as the General Biology course except for a 
slightly more difficult text* The teacher indicates with frustration that the 
text is the saine one th^t they a^e using in the 9th grade class in another 
high school in the district* She rates the text for her General Biology class 
at a 7th grade level despite the fact that students are predcminantly 
eophcooras and juniors* Classes consist of equal numbers of males and females 
averaging 22 students per class* In the Advanced Biology classv 5 students 
were present during observation* The teacher reports consistently small 
numbers in that class* The neighborhood has a large minority population 
(Black and Southeast Asian) which is reflected in the school*s student body. 
But there are few minority students in tliese biology classes and only one in 
the Advanced Biology class* 

The biology wing utilizes an open space concept with three roccas sharing a 
common entry and partial enclosure^ so the teachers must regulate the noise 
levels in the room for fear of distracting students in the next room* Even 
under the best of conditioner it is difficult to listen attentively frm the 
back row of the biology class when other classes are in session* The rocjn 
consists of laboratory tables and chairs with an adjoining storage room* 
Blackboard space is minimal* 

She quickly breaks forth at our first meeting about the research! "^You 
must first understand what kind of school this is and what kind of students we 
have which make it different frcm other schools in the district* This is a 
blue collar school* When I started teaching here 17 years ago there was a 
high drop*<)ut rate among students* Students went to work in the nearby mill 
and stayed in this community to live* The mill is closed now and people have 
to leave the community to work* NOw there is a move toward higher education 
among the students* There is more scholarship money available* We now have a 
program which can provide money to students for two years of college and if 
the students prove they can do the workr they will get more money for the last 
two years* 
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"I come from the south. I understand the importance of education and I 
put £ lot of etnphasis on getting things done. Some kids feel I'lr concerned^ 
others say I interfere. 

"These students respond best to hands-on learning. They have short 
attention spans and need a lot of direction, niere is a tremendous spread of 
ability and Interest in my classes. Therefore^ you won't see long lectures. 
I take a more elementary approach to science because kids still come to high 
school front feeder schools without science programs.^ 



I. ASSESSMENT PURPOSES 

A. Diagnosing individual student needs 

This teacher does not appear to do anything special to diagnose individual 
students needs or alter her curriculum plan based upon such information. She 
does use oral questions to determine student understanding and she adjusts her 
instructional pace based upon her observations aiid her review of their daily 
assignments. She giv^s 20-22 assignments a term (see I.C.) and she considers 
them generally to **get a picture of their weaknesses." She evaluates how tbey 
do the labs from this point of viewt Are they failing to turn them in or 
failing to complete tbem? is there a basic lack of understanding? She 
reinforces every concept twice (students complete ^ workbook along with the 
text) as a matter o£ course because her experience indicates that students 
need it. Her decisions about how much time students need in order to master 
the routines and her accommodation of che great variation of **abilities** 
appear to be rather firmly fixed. 

She mentions thatr do maf:e allowances for outside factors. Some of 
these students come from terrible family situations and in the case of 
dc^nestic violence, they may have to leave in the middle of the night. A 
student may sayr 'We left our papers there.' I understand." 

B. Diagnosing group needs 

(See I. A. above for explanation) 



C. Assigning grades 

**The purpose of the grade is to tell me how many students understand the 
concepts being taught." Graces are an average of 22 assignments a term (i*e.r 
homeworkr special pre jectsr preparatory work, tests, quizzes^ notebooks^ extra 
credit assignments and effort) some of which are assigned pointsr others which 
are noted with marks in the grading book. Straight cut*off scores are used 
for the transformation: 90 percent « A, etc. However, the final grade is 
actually at the teacher's discretion because she considers effort and extra 
credit work heavily when a particular grade is borderline. 
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Hmework is checked isanediately and entered in the gradebook at the 
beginning of class* It must be received by 3:00 of the day it is due in order 
to receive credit* This ensures that the necessary laboratory materials are 
available and that the students will not forget the content under study* 

At the beginning of the year^ laboratory assignments are rated in terms of 
whether simple procedures are carried out* During the second quarter^ sha 
adds the ability to state a hypothesis to the rating process ^ and the third 
quarter she adds the ability to state the conclusion of the experiment* The 
lab procedures a student uses are important* Good ratings go to those who 
completed the lab^ providing all steps and all infoimation* The standard is 
that the procedure should be so clear that another person could followi 
titles purpose^ hypothesis^ materials^ procedure and results* 

Students are required to keep notebooks^ in which they collect weekly 
assigned vocabulary to be learned called "^rep assignments^^ using main ideas^ 
lab reports quizzes and drawings* These contrjlmte to the grade. 

nie teacher gives extra credit assignments every week and borderline 
grades are affected by whether or not a student does extra credit work. 
don't use ^ formula in grading* Effort equals extra work and participation^ 
such as coming ir.* bringing books to classt working together and doing the 
labs in class*^ She explains^ ^Hary had a 77 for the term* She earned a 
letter grade of B because she does the extra credit assignments^ which 
indicate effort* Another student earned a 74 which should have been a C by 
straight recounting but he did no extra assigiunents so he got a D* Another 
student got a 66 which should have been a D but he got a C because he only did 
2 extra credit assignments.^ 

^I*d rather make a mistake with a student because of commission rather 
than omission* I try to give students every opportunity to demonstrate they 
are learning and trying* But if I see it*s a game^ I will call them aside and 
say^ *I won*t accept this*' Some students try all kinds of things.^ 



D* Grouping for instruction 

This teacher does not group for instruction. She assists students to find 
partners during a laboratory but does not expect or require teamwork^ nor does 
she acknowledge learning styles and peer factors as considerations in student 
choices. She simply hc^s that students will be willing to do the work. 

E* Identifying students for special services 

Counselors have the responsibility for placing students in science 
courses, niere had once been a department test which was given to determine 
placement but it was archaic and has Pince been discarded. The teacher does 
not seem to know on what basis placement is made. 
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F. Controlling and motivating students 

The teacher views her students as generally difficult to motivate and ^eep 
on task. She believes they require constant direction and it is this view of 
her students which drives her instruction. Students in all the classes were 
at least coiDpliant and orderly if not always focused upon the work at hand. 
On one particular d£y she pointed out that 6 out of 29 students turned in 
their assignments and that only 19 students were present. Why? ^'Because an 
assignment is due^^*" but she made no coiimient to students about this fact. 
While motivation is a constant issue for her^ she infrequently uses assessment 
to motivate or ctxitrol. She uses an occasional questicxi to direct the 
wandering attention of a student^ or to see what they knew about the materials 
but she does not call attention to student behavior or performance through a 
reference to grades^ or assessment. She enphasized that she spent a great 
deal of time at the beginning of the year directing students^ defining and 
communicating both acadanic and behavioral expectations. Late in the year she 
is simply playing out the script which she assumes students know. Whether or 
not students fully appreciated how she judged their effort for the grade is 
unknown. 



G. Evaluating instruction 

The evidence from observations and interviews suggests that this teachers 
barely makes significant adjustments in her instructional treatments based 
upon assessment data. She operates on the principle of reinforcing everything 
twice^ so students have an additional workbook to complete on each topic along 
with the textbook and laboratory assignments. There is no evidence that she 
does this on the basis of special needs but rather on her experience with this 
general student population over time* 

She commented that her first period General Biology class seemed slower 
than her other classes because they asked a lot of questions. She did not 
know whether it was the group dynamic or simply the ^'working out the kinks*" in 
the instructicxi* When I did an analysis of her grade spread^ I pointed out 
that in fact there were a greater number of A and B grades in her first period 
class then in her other General Biology sections. She was surprised at this 
finding and then surmised^ ^'Perhaps that group is just more inquisitive.*" I 
conclude that she does not have specific evaluation strategies and does not 
ponder the success or failure of a particular instructional treatment. 



H. Communicating achievement expectations 

See I. A and i.c for additional explanation. 

The teacher spends considerable time coraounicating what is expected. Her 
main goal in General Biology is to have 70 percent of her students write up 
labs correctly by third quarter. *'The lab is already written down^ (so it is 
a ccqpying exercise) but the purpose isn^t always stated^ nor is the hypothesis 
or the conclusions. During the first quarter I really focus on this. By the 
final exam they have to write the procedure and they apply it to a problem X 
give.* 
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She uses oral questions^ lab sheets and tests to let students know what is 
expected o£ them* The sheer routine o£ the course reinforces what is 
ioiportant to do in order to learn biology* Each Monday she writes the 
assignments for the week on the boards with extra credit work included* This 
allows her better students to work ahead* But it also communicates to all 
what is expected* 



I* Communicating affective expectations 

The teacher spends considerable time at the beginning of the year and 
again at the start of each quarter reviewing the rules and expectations 
because she believes students need this constant reminder: Participation and 
effort are important and one should come to class prepared^ with h^nework 
finished; ccHQpleting the labs are important to student success* As noted 
abover this teacher occasionally uses oral questions to direct e.ttention and 
ccsonunicate behavioral expectations* However^ she also uses other nonverbal 
ways to coosftunicate her approval, particularly as it related to student 
motivation and effort* Students who are involved in the instruction of the 
class are more likely to sit near the front of the room and she allows these 
students to dominate the student responses* Students who are uninvolved 
appeared to get less of her attention^ even in lab time, although she always 
manages to g«c around to everyone at that time* In sumr those who express 
some effort get her attention as approval* Those who do not, get much less of 
her attention* 



j# Tfest-takinq experience 

There is no evidence that the teacher provides practice in test^-taking* 
She does, however, phase students into the writing of essays* During the 
first termr students take only multiple choice tests* But during the second 
termr when she feels they can handle it, she adds short essay questions* 



II* ASSESSHEHT HETHODOLOGY 

A* Assessment of achievement 

1* Teacher -developed paper and pencil tests 

The teacher indicated that she and her colleague wrote the end of the term 
test together and used the same teacher *deve loped quizzes* The teacher r 
however, was not able to produce ar^ of her quizzes giving me the impression 
that the quizzes were a casualr hurried, assessment device* 

2* Text~embedded tests 

The teacher uses unit exams published along with the textbook* These 
parallel the student workbooks in content and format and match the cognitive 
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leviels d£ those activities which are generally recall^ canprehension^ and 
inference* While she does not examine the quality of these closely^ the tests 
match the instructional objectives arid are well designed* 

3* Performance assessments 

TtiLs teacher relies chiefly upon her observation of student products and 
interactions with students during labs and instruction to determine 
understanding of material* Keeping abreast of the regular assignments is her 
chief means of assessing performance* (see II*A*9* and I*C* for a full 
description*) 

Laboratory assignments are checked carefully to be sure students followed 
the procedures* At the beginning of the year she uses a point system to 
evaluate completeness (see I*C* for explanation)* But by the third quarter^ 
lab reports are given a check for cc^leting the lab and providing all steps 
and all information^ or a plus for incomplete procedures* Zeroes mean that 
the lab assigmcent is unacceptable* Student laboratory work itself is not 
ratedf and she keeps mental notes regarding student effort* 

As noted earlier^ notebooks are required* These ere evaluated in terms of 
thoroughness^ correctness^ completeness and neatness* They are the 
compilation of all daily assignments^ labs^ drawings and tests* Homework 
assignments are simply checked as completed or uncompleted and duly noted in 
the grade book* 

4* Oral questioning strategies 

When presenting or reviewing information^ she generally uses an 
interactive mode of instruction* One gets the feeling^ however^ that she is 
operating on "^auto pilot"* when she is inf^tructing the class because she seems 
to hurry through the lesson with little Consciousness of what is occurring in 
terms of her questioning strategies* Analysis of interactions indicate that 
few students re^ond^ usually the same ones and more often the male students* 
She will ask a student to come to the board and /folve a problem* But she 
usually prods the student along or ccA^letes the problem for the students* 
She is quick to elicit the correct response and usually acknowledges a student 
response with an "^OK*"* Little sustaining feedback is given* In interview she 
is quite aware of who does or does not talk* But for those students who 
choose to tune out in the back or the side of the roomi there appears to be a 
distance between teacher and student during class instruction time* She will^ 
however^ take some time with those same students when the class is working 
individually* 

5* Standardized tests 

Prior to the observations^ the students completed a published test in 
biology being given to OiliforniSf Oregon and Washington students* The 
teacher secured the test from a colleague and knew only that the purpose of 
the test was to improve the instruction of biology* She wasn't sure what she 
was getting back but she participated in hopes that it could assist her 
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instruction. She was very conscientious about having the students coiDPlete 
the follott-up questionnaire assessing tUeir affective response to the test. 
Many of them indicated frustration^ some confusion or boredom. The teacher 
was very accepting and nonjudgmental of their feelings. But it was clear that 
she has had little experience with standardized tests. 



6. Group assessment methods 

TtieBB are not used^ and there is no information to suggest that the 
teacber is informed about such possibilities. She r .^fers to assess students 
individually. Students may work together in laboratory assignments but the 
efforts of each person is assessed individually which she considers a factor 
in ^effort.* 

7. Opinions of other teachers 

The teacher indicated that until the arrival of another female teacher in 
biology last year^ she felt rather isolated and was slowly loosing incentive 
to stay innovative and fresh. She has genuine admiration for her new 
colleague and it is evident that they are working closely on course plannin9. 
I have no data to suggest bow sensitive the teacher is to other teachers* 
opinions about students^ however. 

8. Assessment of reasoning skills 

The teacher wants to know whether student ^understand the material.^ Her 
questioning skills demonstrate understanding of higher order thinking skills. 
She often asks^ ^Why?^ but her general reliance upon recall level activities 
indicate that she bas limited strategies in this area. She recognizes that 
the ability to state hypotheses is central to science and works toward student 
achievement in this area. Bowever^ she feels that students have such poor 
study skills that this interferes with their success in reaching this level of 
thinking. 

9. Regular assignments 

Assignments for the week are posted on the board so that more capable 
students can work ahead. She always has extra credit assignments which are 
usually completed by her students. Homework is regular and consists of 
doing ^preparation work^^ ccnopleting laboratory assignments such as drawing s^ 
writing up the labs in the notebook or doing workbook activities. A workbook 
accc»t{>anies the text and duplicates the context for the purposes of 
reinforcement. 

She relies heavily upon a review of homework to explore student learning. 
Assignments are checked in the first minutes of entry to class. She first 
notes who has completed assignments then she hands the hosnework back for a 
quick review and check. These are often written worksheets from the workbook. 
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11* student peer ratings 

There is no evidence that peer or self ratings are used or regarded as a 
viable assessment tool* Assessment is viewed as a highly individual matter 
directed by the teacher* Past experience with student indifference might 
deter her from considering such an approach^ but given low student motivation^ 
this mi^ht be a useful tool* 

12* Student self ratings 

See 11* above for explanation* 

14« Strategies for integrating assessment and instruction 

nie daily review of homework^ oral questioning of students^ general 
observation of student effort on laboratory and extra credit work are the main 
ways the teacher integrates assess&ent and instruction* Given the products 
students must develop and the teacher's belief in the need to review and 
reinforce the material^ assessment and instruction are well integrated in 
these classes* 

IS* Student cheating 

This issue was not explored with the teacher* 

B* Assesaaaent of affect 

1* Observing individual students 

Although the teacher appears to ignore most student behavior that is off 
task, not too much misses her^ based upon the interviews* She looks for 
effort and participation and rewards stu<?3nts who show such interest with her 
attention^ her favorite form of positive feedback* (See 1*1* for further 
explanation*) 

When describing differences between students^ she distinguishes between 
attitude and effort* John, an A student^ not only gets work in ahead of time 
and typed neatly^ but he stops by 7th period to ensure understanding of 
assignments and participates actively in class discussion* While verbal 
participation is an important indicator of participation^ it is not always an 
accurate reflection of a student's t4ider standing* "Greg is quiet thunder* He 
doesn't ask any questions but his .^ssignnents are always correct* He is an A 
student* I consider bis background* He comes from a private Catholic school 
where it is quiet and respect is important* Hatt on the other hand is quiet 
but is always concerned about time^ when it's tiioe to go* Labs are regularly 
incof&plete* He doesn't ask questions* So it's hard to know whether he 
understands what he's supposed to do*" 

2* Observing group interaction 

See II*fi*l for further explanation* 
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students work together on certain labs but choose their own partners^ 
unless partners interfer with the learning of others* If she sees that 
students are working alone when they should be working together she will 
physically assist a student to move to a group* Actively participating in a 
lab is considered a favorable indication of effort* 

3* Using questionnaires 

13iere is no indication that the teacher uses quest iorj'J: ires or is informed 
about the advantages and limitations of their use* 

4* Using interviews 

Interviews are not used by this teacher* She does engage in informal 
conversations with students to ^ain an insight into their background* As the 
examples in I*A* and II*B*1* indicate^ she uses such information to understand 
variations in student class participation and effort* 

5* Opinions of other teachers 

There is no evidence that this teacher seeks out or is interested in the 
opinions of other teachers* As noted in II*A*7* her new colleague is a 
welcome support and provides the insight and creativity she has been missing 
in her professional contact for some time* Bow this influences her 
perceptions of student affect is unknown* 

Opinions of other students 

niere is no evidence that the teacher seeks opinions regarding student 
affect from other students* 

7* Opinions of parents 

She notes that the contact with parents is either nonexistent or 
negative* When she in^lemented a weekly cosputeri2ed feedback system to let 
parents know how students were doing the only reaction she got wasr ''Why are 
you doing this?" She concluded that it was net worth the time and effort* 
Parent opinion is now neither sought after nor regarded as productive for 
student performance* 

8* Past student records 

There is no evidence that this teacher uses past records of students* 

9* Affective characteristics measured 

Effort is the one characteristic which is tied to a particular indicator* 
Students who do extra credit work indicate their effort and motivation and are 
usually rewarded in the term graide* Because the teacher carries the weight of 
17 years experience in a "difficult" high school^ it appears that indicators 
of student interests^ valuesr learning styles are ignored* As discussed above 
in I*A*^ she indicates sensitivity to students^ family situation especially 
when she believes the student is sincere* The curriculum appears^ howeverr to 
be quite rigid and rather inopervious to student affective characteristics* 
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C. Assessment of ability 
1. Meaning of ability 



The teacher refers several times to *a wide range of abilities" in her 
General Biology classes; her Advanced Biology students are not the 'cream of 
the crop." However^ there appears to be a confusion as to whether ability is 
an innate cognitive factor or whether it refers to prior achievement. She 
will sayr 'Tcsm is bright; his parents had an education. Unf ortunatelyr there 
is no way to accommodate him with such a ^^ide range of abilities. ' ht other 
times she refers to requisite skills needed to perform the task at hand such 
as the willingness to sustain effort or read at grade level and work 
independently. In this context she states that m*ay of her students come from 
feeder schools which stilX do not have science programs or give homework^ 
rendering some of them unable to work independently. For herr one of the 
characteristics of lower ability students is that they need to be directed 
constantly. 

2- Decisions influenced by assessment of ability 

The teacher describes her instructional strategy in the General Biology 
classes as fluctuating from accommodating the low end to the high end of the 
spectrum of ability so that all students will be reached at socie time but I 
did not see how this was actualized. Instead I saw that she reinforces every 
toi^ic twice with an additional workbook activity whether all students need to 
or not. 

She admits that she makes no special provision for the Advanced Biology 
class except that they use a more difficult text. 

D. Text assessments 

The teacher relies heavily on the teacher edition of the textr for unit 
examsr activities and homework. Instruction follows the text and the students 
use an additional workbook which acccmpanies the text. 



III. CRITERIA FOR SELBCTXHG ASSESSMENT METHODS (h-K) 

Criteria for selecting assessments were difficult to discern. In terms of 
tests, the teacher relies heavily upon the text publisher's tests. She 
constructs the final exam and until this year used only a multiple choice 
format partly because of poor student writing abilities. She is making a 
conscious effort to include more writing in the tests this year but phases the 
students into it slowly. It appears that she is doing this because of the 
writing across the curriculum efforts and because she sees value in it for her 
students. 

Her unit tests indicate that she is minimally but adequately versed in 
test construction and that the kind of mental operations she fosters in her 
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class are reflected in her test items. Host of her assessments are done 
through review of the regular assignments (see II. 9. for further explanation) 
and are consistent with her purpose and match the content taught. I infer 
that efficiency is a factor in her assessment of these assignments. She is 
somewhat informed about these matters but these issues are not a primary 
concern for her in her teaching. 



• IV. QUALIIY OF ASSESSMENTS 

A. paper and pencil assessments 

Host of the items on the teacher made tests are recall and inference with 
^ some comparison. True/false and matching were the most common format found in 

^ both teacher made tests £nd toxt publisher's tests. Both kinds of tests 

matched the content and cognitive levels of instructir.^. Certainly the 
publisher's unit test was clearer in terms of directions and production. One 
teacher made final exam had typographical errors and repeated items. Overalls 
the tests were adequate in meeting the teacher's expectatioris which were to 
(1) indicate which students had ^comprehended* the materials and (2) assist in 

# assigning grades for the term. 



B. Performance assessments 

The format for writing the 1^ ratory reports is rather typical for the 
discipline (see I.C. for explanation) r but her standards of thoroughness^ 
neatnessr and completeness emphasize correctness and neatness over creativity 
and conceptual understanding. Students know the conditions for acceptable 
homework andr as with the laboratory reports, these are conveyed repeatedly 
through verbal rather than written instructions or exaicples. Effort and 
participation are defined asr ''coming to class with booksr homework^ 
completing laboratories^ participating in class discussion and doing the extra 
credit assignments." Overalls performance criteria are vague. 



C. Oral questions 

See I I.C. for description. 



V. FEEDBACK PKOCEDOHBS 

♦ A. Oral and nonverbal feedback 

The evidence from observation indicates that this teacher attends to the 
stronger^ more able student. In interview she never pointed out an able 
female student. Her style of instruction allows for students who are willing 
to dominate the class question/answer exchanges. She calls upon students but 

# boys tend to be the ones to call out unsolicited answers^ thus trying to 
control the verbal exchanges. She seemed to accept this. 
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She is very quick to "move in" on an incorrect response but is just as 
likely to respond with^ "CK^" to either a correct or incorrect response* Ker 
manner indicates a concern for correctness and she might impatiently ask a 
student^ "Hhy are you doing it that way?" 

On two separate occasions she reprimanded female students* One handed in 
the hcmework after the due date and the teacher publically chastised her with^ 
"you know better than that by this time of the year*" She was obviously 
irritated by the student* On another occasion she registered obvious distain 
for the rather defiant posture of one female student dressed in punk attire* 
I did not observe her being as harsh on the male students* 

While students are working on laboratory assignments or homework she is 
quite accessible* She will respond to anyone who requests her and checks on 
those who are drifting off* Those who sit in the front of the ro<M tend to be 
the more active students and they receive more of her feedback then those who 
sit in the back of the room* It appears that by April she knows who is a good 
student and who is hopeless and she appears to be more responsive both 
verbally and nonverbally to those who are able and willing* 



B* Written feedback 

The teacher has always used some system to record grades so that students 
know where they stand* Originally she posted assignments and quiz records on 
the wall* She put a check mark if the assignment and quiz were done* Test 
grades were not posted because that information is private* Two ye;^ j ago she 
started a computer system to provide a weekly print cut of grades but the 
students **weren*t ready for it* It was too frustrating to many* Some kids 
wanted to always know where they stood but for the majority it didn't make a 
difference* Parents signed it once a week and every 4 weeks I sent a letter 
home on the computer to the parents* Only one parent ever wrote back and it 
was negative* it was so much work* I concluded that I*m too accommodating* 
Now I use a new systemr a typed f-^rnt for student recordkeeping* Those who 
want to can keep track of how they are doing* It is not required* Only a few 
use it but it is their choice*" 

The teacher selected the notebook of her best students to illustrate 
student work* Bew written comments were noted* By this time of the year 
students are sinqply receiving a checkr plus or zero for their laboratory 
procedures which must include all the steps* Biomework is handled in a similar 
manner* It is the student's responsibility to correct the written work if it 
is done inadequately but sometimes she does add written corrections* She is 
not likely to write comments at this juncture of the year* She sti.U looks to 
the homework to indicate student weaknesses or misunderstandings but she is 
more likely to respond to these through instructional review with the whole 
class* In generalr very little written l^eedback is given* 
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VI 4 DESCRIPTION OF TEACHER AND ASSESSMENT 

B* Teacher's expenditure of time 

1* Time spent in teaching activities 

Most of her time is spent in group instruction; least is spent in 
assessment-related activities* it is difficult to judge how much tiihe this 
teacher actually spends in planning* Biology requires a certain amount of set 
up time but it appears that th« textbook drives the course* Several times in 
her pre sen tat ions f she seemed insufficiently prepared in the science area and 
twice students corrected her misinformation* Her openness to the new ideas of 
her colleague and willingness to coordinate the biology program more carefully 
with her indicates that she may be doing more now than in the recent past* 

2* Time spent in assessment activities 

niis teacner spends most of the asisessment time on regular assignments, 
scoring^ recording and providing feedback in terms of instruction* The text 
publisher's tests are simply administered without mi^h review and the 
teacher's quizzes are constructed rather quickly* It is likely that the same 
term exam is given from year \.o year* in shorts the assessment process is 
established and receives little attention* 

C* Teacher characteristics 

This teacher seems to genuinely like s-^udents as she appears to like 
people* Seventeen years in a setting with little perceived support and a 
student population known for learning difficulties has not negatively affected 
her sense of professional efficacy* Within a r^arrowly defined concept of 
science education she takes pride in the fact tnat she is considered a 
denanding teacher but she leaves the obseiver with the feelii:^ of a teacher 
who is operating on auto control during instruction* The inte^tpersonal 
environment of the classroom regarding assessments is best characterized as 
neither cooperative nor ccmpetitives rather^ highly individualistic, with 
students appearing indifferent and unresponsive to each other* Whether the 
teacher views this as proper climate or whether she feels powerless to change 
the situation is unknown* Bowever^ the positive potential of student peer 
relationships may b& a rich and useful strategy for her to develop^ given the 
motivational needs of the students* 

She makes her decisions baseu upon her years of experience and this tends 
to reinforce a stereotypic view of student edibilities* The net result ir to 
constraint student opportunities rather thAn expand them* For example^ a 
""misplaced** student once turned on the qas jets and lit a matchf endangering 
the students* Arother time, with a substitute teacher in charge^ the students 
threw out the frogs for dissection* Siie now nimply avoids activities which 
might be risky, costly or create management problems* 
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VII* TEACHER'S PERCEPTIONS OF STUDENT CHAKACTERISTICS 

The first thing the teacher tcld me was ^^IJhere is such a wide range of 
abilities in these classes that there is no way I can accofnmodate the bright 
student*** The teacher believes that the nature of her student population 
seriously affects what she can accomplish with th&xif and for the most part, 
variation within the student population on these characteristics is ignored* 

An analysis of her grade distribution for two terms indicates that there 
is little change in an individual's grade over the course of the year* only a 
few students move a grade either way* Indeed , one*fourth of her General 
Biology classes receive D's and P's* On the one hand she mentions that every 
student failure is her own failure as a teacher^ but the evidence suggests 
that she attributes more to student prior achievement and level of motivation 
than to her own ability to intervene* There is little evidence that there are 
changes in students characteristics as the year unfolds* 

Her strongest cceiments about her feelings about her students came in 
response to questions about parental expectations* These expectations have 
either been nonexistent or negative and thus have had the effect of 
frustrating her or waring down her ccHmnitment and energy* 



VIIJ* ASSESSMENT POLICY 

Because of interview constraints, detailed information regarding her 
^ knowledge of district and school assessment policy was not obtained* But this 

teacher has been teaching in the same district and school for seventeen years 
and knows the basic ground rules* Her assessment practices are within the 
scope of ccomionly accepted teacher practice* She reports attendance and keeps 
track of absences and tardiness waich do affect a student's ^rade* I do not 
know if the school has a homework policy but her practice of requiring 
hoaework to be turned in on the day it is due seems consistent with other 
teachers' pracf'^e in the district* She is aware of and influenced by 
district specified policies regarding content to be covered* indeed* she feels 
constrained by the district*mandated textbook she uses for General Biology* 
Both she and her colleague believe that it is a poorly written bok with many 
misspelled words and misinformation* But she continues to use it despite her 
I objections* 



PBOFXLE OF BIOLOGY CASE #2 



X. ASSESSMENT PUHPOSBS 



A. Diagnosing individual 
student needs 



B. Diagnosing group needs 



C. Assigning grades 



D. Grouping for instruction 
within class 



E. Identifying students for 
special services 



F. ControlXing and 
motivating students 



G. Evaluating instruction 



H. Communicating achievement 
expectations 



Uninformed X Well informed 

Irrelevant X__ Relevant 

U se le ss X_ Use f ul 

Not used X Used frequently 

Uninformed X Well informed 

Irrelevant X Relevant 

Useless X Useful 

Not used X Used frequently 

Uninformed X Well informed 

Ir i.e levant X fie levant 

Useless X Useful 

Not used X Usea frequently 

Uninformed _X Well informed 

Ir re levant X Be levant 

Useless ^JC Useful 

Not used _X Used frequently 

Uninformed X well informed 

Irrelevant X Relevant 

Useless _X Useful 

Not used JC used frequently 

Uninformed X Well informed 

Irrelevant X Relevant 

U se le ss X Use f ul 

Not used X Used frequently 

Uninformed Well informed 

Ir relevant X_ Re levant 

Useless X Useful 

Not used X used frequently 

Uninformed X Well informed 

Irrelevant X_ Relevant 

Usele ss X_ use f ul 

Not used X used frequently 
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I, Coinmimicating affective 
expectations 



J. Providing test-taking 
experience 



Uninformed X Well informed 

Irrelevant X_ Relevant 

Usele ss X_ Useful 

Not used X Used frequently 

Uninformed X Well informed 

Irrelevant Relevant 

Useless _^ X Useful 

Not used X Used frequently 



K. Relative importance 
of purposes 



50 



Given '100 importance points'* to distribute 
across the purposes listed belowr how would 
you distribute those points to reflect the 
relative iiq^rtance of the decisions listed? 



Diagnosing individual needs 
DiagiVQsit^g group needs 
Assigning grades 
Grouping for instruction 
Identifying students for 

special services 
Controlling and 

motivating 

Evaluating i/atruction 
Communicating achievement 

expectations 
Communicating affective 

e^ec tat ions 
Test taking experience 



20 



15 



10 



100 points 
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lit ASSESSMENT HfiTBOOOLOGV 

A* Assessment of Achievement 

1* Teacher*deve loped paper and 
pencil tests and quizzes 



2* Text-embedded paper and 
pencil tests and quizzes 



3* Performance assessments 



4* Oral questioning strategies 



5* Standardized tests 



6* Group assessment 
methods 



7* Opinions of other teachers 



8* Assessment of reasoning 
skills 



Uninformed X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used X Used frequently 

Uninformed M o in fo Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used X_ Used frequently 

Uninformed M o in fo Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X Used frequently 

Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X Used frequently 

Uninformed X Well informed 

Inappropriate _X Appropriate 

tiseless _X Useful 

Not used _X Used frequently 

Uninformed h o in fo Well informed 

Inappropriate X Appropriate 

Useless X_ Useful 

Not used _X Used frequently 

Uninformed N o in fo Well informed 

Inappropriate X Appropriate 

Use le ss N o in fo Useful 

Not usea N O in fo Used frequently 

Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X Used frequently 
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9» Regular assignments Uninformed X_ Well inforiried 

Inappropriate X_ Appropriate 

U se le ss X_ Use f ul 

Not used , X Used frequently 

10* Student peer rating Uninformed N o in fo Well inforined 

Inappropriate X Appropriate 

Useless Useful 

Not used X Used frequently 

11* Student self ratings Uninformed N o in fo Well inforined 

Inappropriate X Appropriate 

Useless X_ Useful 

Not used X ^^^^ Used frequently 

12* Proportion of all assessments for all purposes that are of various types 

Teacher -developed paper and 

pencil tests 5^ 

Text-embedded paper and . 

pencil tests 40 
Performanoe assessments 0 
Oral questions 15 

Standardized tests SL 

Opinions of other teachers 0 
Begular assignments 40 
Group assessments 0 

Student Peer ratings 0^ 

Student self ratings 0 

100% 



13* Cognitive levels of questions posed int 



Study and Oral Tests and 

Discussion Qcestions Questions Quizzes 



Recall 

Analysis 

Ccn^parison 

Inference 

Evaluation 



50% 

40% 
10% 



50% 
20% 
20% 
10% 



60% 
15% 
20% 
5% 
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14. Strategies for integrating 
assessment and 
instruction 



15* Dealing with cheating 



B# Assessment of Affect 

1* Observing individual 
students 



2. Observing group 
interactiors 



3. Using questionnaires 



4* Using interviews (formal 
and informal) 



5. Opinions of other 
teachers 



6# Opinions of other 
students 



Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X Used frequently 

Uninformed M o inf o Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used N o in fo Used frequently 

Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X Used frequently 

Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X Used frequently 

Uninformed N o inf o Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used N o in fo Used frequently 

Uninformed N o inf o Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used N o inf o Used frequently 

Uninformed N o inf o Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used N o in fo Used frequently 

Uninformed ^o inf o Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used No int o Used frequently 
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7* Opinions of parents 



6* Past student records 



Uninformed X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used _X Used frequently 

Uninformed No in fo Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used N o in fo Used frequently 



9« Giecklist of affective characteristics measured: 



Seriousness of purpose 

Motivation and effort 

Attitude 

Learning style 

Interests 

Values 

Preferences 

Academic self-'concept 

Locus of control 

Anxiety 

Maturity 

Social skills 

Study skills 

Other (specify: Family situation 



F = fonoal assessment conducted 
I * informal assessment conducted 



10* Relative importance of affective assessment methods: 

Observing individual 

students 
Observing group 

interactions 
Using questionnaires 
Using interviews 

(formal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Past student records 



C# Assessment of Ability 



10 



100% 



1* Meaning of ability for teacher 
Value of this factor 
for the teacher 



Important 



X Unimportant 
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Measurement of ability Measured formally 

Measured informally 

Not measured X 



Ingredients considered in assessment of ability, if measured: 

FACTOH(S) INCLUDED IN ASSESSMENT MEASURED HOW? 

• 1. 

2* 
3. 

• 4* 

5. 



2* Check decisions influenced by results (i*e.r change with varying levels of 

# ability) . 

Instructional objectives 

Instructional strategies 

Grouping for instruction (within class) 

Methods for measuring achievement 

• Grading standards 

Students selected for special services 

Other (^ecify ) 



D, Text Assessments 

Checklist of assessment components provided with text 









'S 




m 






X 


X 


X 


X 


X 


X 


X 


no 


no 


no 



Oral questions for class use 
Homemrk assignments 

General assessment guidelines for teachers 

Paper and pencil tests 

Performance assessments 

Scoring guidelines 

Quality control guidelines 

Other (specify 
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Ill* CRITERIA FOR SELECTING ASSESSMENT METHODS 

A. Results fit purpose Uninformed X well informed 

Un impor tant X Impor tan t 

Not used X Used frequently 

B» Method matches material Uninformed X well Informed 

taught Unimportant X Important 

Not used X_ Used frequently 

C. Ease of development Uninformed X Well informed 

Unimpor tant X Impor tant 

Not used X usea frequently 

D. Ease of scoring Uninformed X well informed 

UniiDportant X Important 

Not used , JL Used frequently 

E. Origin of assessment Uninformed X Well informed 

Unijnportant , X Important 

Not used X_ Used frequently 

F» Time required to Uninformed ^JC well informed 

administer Unianportant X Important 

Not used X Used frequently 

G. Degree of objectivity Uninformed X Well informed 

Unimportant , X Important 

Not used X Used frequently 

fi. Applicability to Unirformed X well informed 

measuring thinking skiMs Unimportant X Important 

Not used X Used frequently 

I* Effective control of Uninformed No in fo Well informed 

cheating Unimportant N o in fo Important 

Not used No in fo Used frequently 
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J* Relative importance of criteria 



Rcisults fit purpose 10 

Method matches material taught 20 

Ease of development 20 

Ease of scoring 20 

Origin of assessment 

Time required to administer 

Degree of objectivity 20 
Applicability to measuring 

thinking skills 10 

Effective control of cheating 

100% 
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IV. QUALITY OF ASSESSMENTS 

A* Percent of paper and'Pencil assessmenta (teacher '-developed or text*-enbedded) 
having the following characteristics (need not total 100%): 

% 

0 Clear description of assessment specifications 
100 Matches content of instruction 
100 Matches cognitive levels of instruction 
K o info Minini2es time required to gather ncoded information 
Item format matches desired outcone 
Items clearly written 
Items sample domain 
H o info Scoring procedures plemned 

0 Scoring criteria written for essays 
50 Clear directions 
60 High quality reproduction 
No info Test scheduled to minimize distractions 



B* Percent of performance assessments having the following characteristics i 
% 

0 Clear description of trait to be measured with levels of 
proficiency articulated 
60 Matches intended outcomes of instruction 
60 Minimises time required to gather needed information 
30 Clear performance criteria 
60 Students aware of criteria 
0 Thoughtful exercises yield performance samples 
Exercises sample performance domain 
0_ Performance rating planned 



50 Results match information needs 

C* Percent of oral questions having the following characteristics: 
% 

Sampling methods cover range of achievement levels of students 

,20 Strategies involve everyone 

,. 30, Teacher waits for response 

., .20 Student's response given supportive reaction 

60 Questions match cognitive levels of instruction 
Written performance records maintained 
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V. FEEDBACK PROCEDURES 

A. For oral and nonverbal feedback 

Percent of feedback delivered to students who are: 
% 

70 Strong (vs. weak) 

70 Correct (vs. incorrect) 

70 Male (vs. female) 

Percent of feedback having the following characteristics! 
% 

70 Delivered in class (vs. out of class) 

70 Oral (vs. nonverbal) 

SO Public (vs. private) 

90 Pair (vs. unfair) 

70 Focused on achievement (vs. affect) 

90 Germane (vs. irrelevant) 

90 Immediate (vs. delayed) 

70 Positive (vs. negative) 



B. For written feedback 

percent of feedback delivered to students who are: 
% 

SO Strong (vs. weak) 
20 Correct (vs. incorrect) 
N o info Hale (vs. female) 

Percent of feed^ack having the following characteristics: 
% 

10 Comment (vs. symbol) 

30 Positive (vs. negative) 

70 Fair (vs. unfair) 

100 Germane (vs. irrelevant) 

90 Focused on achievement (vs. affect) 



Uses samples of performance Never Jt Frequently 

as feedback 



Uses public achievement chart t'ever X Frequently 

as feedback 
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VI* DESCBIPTION OF TEACHER AND ASSESSMENT 

A* Teacher's background 

1* Teacher experience^ number of years: 



17 Overall 



_17_ At grade level 
17 In school 



17 With content 



2* Relative contributions of various sources to teacher's knowledge of assessment 
methodology 



20 



20 



20 



40 



loot 



Teacher preparation training 

Inservice training 

Ideas and suggestions of colleagues 

Professional literature 

Teacher's guide textbooks 

Own experience in classroom 



B* Teacher's expenditure of time 
1* Proportion of time spent in teaching activities 
t 

_20_ Planning 

Teaching (one on one) 



20 



,50^ Teaching (group) 
10 Assessing (see list' below) 
Other (specify 



loot 



2* Proportion of time spent in assessment activities (paper and pencils performance 
assessment^ oralr assignments) 



Reviewing and selecting assessments 



10 Developing own assessments 
5 Administering 

Scoring and recording 
Providing feedback 
Evaluating quality 



20 



100« 



C* Teachei: characteristics 



Role in the classrocnn 



Curriculum maker 
and presenter 



Servant of policy 
delivering 
required content 



184 



Expectations of Expects a 

professional self Expects little X great deal 

Structure needs Rigid X flexible 

View of high Coriectriess ':''9rees of 

quality performance demanded _X ,uality eval. 

Stereotypic view of students None X Expressed often 

Attends to exceptional student Never X Frequently 

Sense of performance norms Un;lear X Vtery clear 

Orientation to experimentation No risks _X Risk taker 

Orientation ti cheating No concern No info Major concern 

Amount of cheating None No info A great deal 

Value of pronptness; importance 

of timely vork cmpletion Unimportant X_ Important 

InterperBonal environment of 

the classroom regarding assessment: 

Cooperat ive None X Frequent 

Competitive None _X Frequent 

Attributions for reasons of 
5\:udent success/failure: 

70 Due to student 
30 Due to teacher 
100% 

Basis for grading students: 

Se'ise of ability 

100 Demonstrated achievement 
100% 

Interpretation of assessment: 

Norm-referenced 
. . Cr iter ion-referenced 
)0% 
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VII. teacher's perceptions op ST'JDENT CHARACTERTSTtCS 

A* Ability to leairn low X High 

No variation X_ Great deal 

Variation ignored X_ Addressed 

B. Willingness to learn Low _X High 

tflo variation X_ Great deal 

Variation ignored X Addressed 

C# Rate of achievement Low X High 

Decreasing X Increasing 

No variation X_ Great deal 

Variation ignored X Addressed 

D# Maturity Irresponsible X Responsible 

variation X_ Great deal 

Variation ignored X Addressed 

E# Study skills Undeveloped X Developed 

No variation X Great deal 

Variation ignored X Addressed 

F# Social skills Undeveloped X Developed 

No variation X Great deal 

Variation ignored _x Addressed 

G* Willingness to perform Reticent X Willing 

No variation X_ Great deal 

Variation ignored x Addressed 

H* Feedback needs Wfeak _X Strong 

No variation X Great deal 

Variation ignored X Addressed 

I* Self -assessment skills Undeveloped X Developed 

No variation X Great deaJ 

Variation ignored X Addressed 
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VIII. What i>oiicied influ^r;^ classrooa^ ossesaiDent? 

Federal State 



ORIGINS 
District 



0 F 



POLICY 
School 



Department 



Colle9ial 



t4 

o 

o 

o 
o 



4^ 



^4' 



^ 0 

II 



A« Doee d standard exist? 
B« Does teacher know 

standard? 
c,, Doee it itnpact 

Practice? How? 



no 

n/a 

n/a 



no info 
fi^ no info 
^* no info 



A* no 
n/a 
n/a 



A. no 
^* no 
^* no 



no 

no info 
no 



yes 
yes 

teacher follows 
guidelines 



A* no info 
B. no info 
c. no info 



A. yes 
B* yes 

Q\ class size 
within limits 



no info 
no info 
no info 



yes 
B. yes 

teacher follows 
guidelines 



yes 
yes 

^* teacher uses th 
text selected 
by district 



yes 
B. yes 

teacher followp:^ 
practice 



A. no info 
no infc 
c. no info 



yes 
yes 

class size 
within limits 



no info 
no info 
no info 



no info 
no info 
< no info 



A. no in^o 

B. no info 
c. no info 



no info 
B* no info 
no info 



A* no info 
B. no info 
no info 



yes 
yes 

yes/ all testin 
€t planning is 
now done in 
cooperation with 



the new biology 
teacher 



A. yes 

B. yes 
c. nomework due by 

3:00 pm every 

day 



no info 
no info 
no info 



A* yes 
B* yes 

see above 
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LANGUAGE ARTS CASE STUDY #1 



Background Information 

This English teacher teaches literature and composition at a 4-year high 
school in a working class neighborhood where few students ^re expected to 
continue on to 4-year colleges. The neighborhood has a large minority 
population (Black and Southeast Asian) which is reflected in the school's 
student body. 

This teacher teaches five classes per day: American Literature (25 
students* mainly sophoinores) ; two classes of Advanced Coniposition (17 and 13 
students* respectively* mainly juniors); Advanced American Literature (22 
students); and Advanced Senior English (26 students). There are seven periods 
in the school day, the seventh being considered a period for students to 
consult with teachers and/or make up tests or assignments. This teacher has 
one additional free period a day. she is also the advisor for the school's 
National Honor Society chaipter (which, she notes, is quite small). 

The students in this teacher's classes are primarily white. Her American 
Literature class has the highest minority enrollirent* about 30% (Black* 
Hispanic and Southeast Asian). Girls outnumber boys in all but one of her 
classes* and in Senior English the ratio is two girls per boy. 



I. ASSESSMENT PURPOSES 

This teacher states that she uses assessment for various purposes: (1) at 
first to get an ^estimate of the house^-^-^to see what she's got and what she 
c?n expect of individual students; (2) to teach ideas and concepts* 
particularly to identify or recognize any sparks and be able to encourage 
them; (3) to -nes^^ure what the students have learne<3; and* on the ^upper end" 
of the spectrum* (4) to measure what theyWe done with vhat they've learned* 
that is* how it has changed their thinking. 



0 A. Diagnosing individual student needs 

Sizing up: At the beginning of the year, the teacher collects a writing 
sample from the students. The sample, which is never returned* is used by the 
teacher for several purposes: to see if the student is properly placed; to 
identify any troubled students (the content) ; and to get an idea of the 
0 student^s power over the language* as a baseline for later concerns regarding 

plagiarism. 

Throughout the course of the semester* the teacher uses oral questions in 
class* regular assignments and tests to monitor individual students' progress 
and particular problems. This teacher seems to give considerable attention to 
0 individual needs. She likes to have students work on assignments in class so 

that she can observe and be available to individuals as they need help. In 



ERIC 



143 



her literature classes^ although the emphasis is not on grammar^ she usually 
takes time to mark grammatical or spelling errors (but does not grade 
them — she used tor see C* below) and if a number of students are having the 
same problem she will adjust her teaching plan to clarify the point of grammar 
in question* 

B# Diagnosing group needs 

In generalr this teacher seems very accustomed to diagnosing and 
assessing* During our conversations she was always judging^ comparing these 
classes to other classes she*d hadr to other years r to the other school where 
she taught previously* I had difficulty getting a clear view of how she does 
it* It seems that a lot of it is in her headr based on her many years of 
experience (20)* She doesr however^ use concrete forms ot assessment to help 
her form her judgments* 

She commonly uses oral questions to determine where the group is on the 
assignment (re completion and understanding)* Similarly^ she uses the results 
of written assignments and tests to identify the group^s need for further 
clarification or emphasis on a particular topic* 



C* Assigning grades 

This teacher would prefer not to give grades if it were possible* She 
r&marksr **Who cares about specific grades? What is important is to be 
successful and get sc^e learning*** On another occasion she exclaimed^ **I 
don't r^ember what grades I got in high school* Who cares?** (Howeverr she 
doesn*t deny the utility of grades for getting into college*) She tells her 
students that she would be happy to give everyone A*s if they did the 
vork~you don^t have to be brilliant to do well in her classes* Her grading 
system is based on pointsr mainly because she feels it is easier for the 
students to see where they are and what they need to make up* klso, with the 
point system there is no quibbling about an A" or a along the way* She 
doesr however, given an occasional plus or minus final grade* Pinal grades in 
a course are based on a percent of total points achieved! 

88 - 100 » A 
73-87 * B 
68-77 « C 
50 67 = D 
Below 50 * P 



Points on individual assignments and tests — which are mainly short answers and 
essays — are given based on how the group does^ that isr they are 
norm-referenced, rather than criterion^-referenced* In fact^ she cited an 
instance when a class hadn't done well on an objective test (the highest grade 
was 38 out of 50) and she had decided to toss it out completely (after making 
sure that no one would be hurt by that decision)* 
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In her literature classes she used to grade all writing on two levels^ 
content and technical quality* lu^ content or substance grade was the most 
important* A student could get an A in the class if she brought her technical 
level to a for exaniple* But the teacher no longer grades on technical 
quality (unless the course is focused on composition or greunmar)* Howeveri 
she continues to mark technical mistakes and may even take time out from 
literary instruction to teach a point of grammar when the error is common 
across a number of students* Why she decided not to greKle the technical 
aspects of English is a little unclear* In part it seems to have been a 
decision based on efficient ube of her time and energy* 

This teacher really seems to de^mphasize grades* She doesn*t state the 
number of points a question or an assignment is worth unless students press 
her on itr and even then she may be rather vaguer saying ^Ohr X don't knowi 
what do you think? At least about the same as the last one*^ Assignments and 
tests are returned with number of points over total number possible* 
Occasionally a student will askr ^Is that an A?^ and she will mentally 
calculate it in her head on the spot* 

She notes having had particular difficulty with the grades for her regular 
(as opposed to Advanced) American Literature class last quarter* This is one 
of the lowest level classes she has taught* They do very little* For the 
first time in 20 years she finds that her gradebook is nothing but a series of 
^messages*^ She notes that she is glad that the third quarter grades were 
merely ^advisory^ because she was very dissatisfied with how they turned out* 
She feels they did not reflect the students* abilities or how hard they 
worked* She*s not sure how she will handle it this quarter^ but she is 
considering throwing out the grades and starting over, using the top students 
as a standard* She notes that attendance (presence in class) was ^totally 
chaoticr" that isr students attended very erratically* She wants to figure 
out a system that will encourage and reward attendance and that will be fairr 
the implication being that fair equals a reflection of effort as well as 
quality* (I i^ver quite understood what she meanti even though I probed on a 
different OGcasion*-she was perturbed by her grading of this class but didn*t 
explain the problein(s) * According to the gradebook^ there were far more F*s 
in this class than in any other*) 

D* Grouping for instruction within class 

She generally teaches her classes as a group* However r she allows for 
considerable differentiation in individual pace* Exceptional students who 
complete their work on time (or early) are scxaetimes allowed to do other work 
for other classes or are given special assignments, such as additional 
readings* She is willing to take time to meet with them to discuss such workr 
either while the other students are working on an assignment in class or 
during her free period or the 7th period* For example^ in the Senior English 
classr two girls were interested in doing additional reading that would help 
them prepare for collegei so she arranged to discuss Candide with them and a 
girlfriend of theirs who was already attending college* Similarlyi a 
Stanford-bound boy in that class followed up on her suggestions regarding 
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additional readings when they were working on satire. In her Advanced 
American Literature class she has allowed for considerable individuality of 
interests by allowing students to choose from five different novels; she has 
small groups of students reading these novels simultaneously (and must keep up 
herself with all of them). And even within those groups she has found that 
students are progressing at such different paces^ despite her suggested 
reading assignments^ that she has decided to allow some groups to break into 
two for discussion. (See 6. below for more regarding pacing.) 

E. Identifying students for special services 

She has had about a dozen mainstreamed kids in the last 2 years^ 
identified as such by the administration prior to inclusion in her classes. 
(Her main complaint about mainstreamed kids was administrative™too much 
paperwork is required of her to report back to the Special £d. Dept.) She 
noted that she recently found out that a particular student was mainstreamed. 
They hadn't notified her. She said it had been clear to her that the girl 
couldn't do high level work^ but she was pleasant, worked very hard and turned 
everything in. She gave her a B last quarter. She recently saw her overall 
GPA and was surprised to see that it was a 2*5, but knew that something was 
wrongs that they must not have been high level classes. Nevertheless, she 
concludes that the girl will function okay. 

She also gave the example of a girl who she determined had been placed 
wrong. She was in the Advanced American Literature course and it really 
wasn't fair^ because she was doing perfectly acceptable work for the ^regular* 
American Literature class and would have received a better grade for her work 
if she had been properly placed there. The teacher managed to get the girl's 
grade changed to reflect what it would have been had she been placed 
correctly. She notes that she's not sure if she could write them down, but 
she does have parameters within which she expects a class to fall^ and each 
group varies within those (if students are properly placed). Once in a while 
someone is *all alone way beyond" and then she tries to give that student the 
extra stimulation he or she needs (see above). 



P. Controlling and motivating students 

The students in these classes require constant monitoring and regular 
reprimands for their behavior in class. This teacher prefers to deal with 
problem behavior nonverbally (and indeed would prefer not to have to deal with 
it at all'.) — using a glare or a pause»but finds herself compelled to use 
other more overt methods to control and motivate the majority of her 
students. In general she tolerates considerable "off^task* behavior in her 
classes. (The extreme case was one day in Senior English when two girls were 
allowed to work out in the halls because they could concentrat3 better there 
than in the classroom;) However^ she and the students have cane to know each 
other, by this time of year and have established certain limits beyond which 
the students will not go. The students respect her and there is an 
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undercurrent of humor and even affection betmen teacher and students. Her 
subtle sarcasm is not wasted on them, and even when they appear not tc. respond 
to her direct reprimands^ they eventually settle down to work (if only cox 
brief periods of time) * 

She does use various assessment methods to control and motivate students, 
however* She sometimes targets oral questions at students who axe obviously 
not paying attention, particularly if they are beconing loud and obtrusive* 
She noted that she occasionally uses a quiz ^to wake them up*" and qet them on 
task (I saw this only once^ in one class at the very beginning of the class 
period) 4 

On numerous occasions the teacher remarked that students at this school 
need to have everything broken down and graded (as compared to the other 
school at which she taught)* Getting points for the work seems to be ^si 
motivator for these students* I observed several instances where she overtly 
used the award of points to control or motivate kids* In one of the Advanced 
Con^sition classes^ a bey didn't want to do the essay part of the assignment 
because he said it was too bard* The teacher responded that is was "half the 
points" and be immediately said, "Okayr 1*11 do it*** She went on to look over 
the rest of his paper and encourage hiiQ regarding how easy it would be and 
noted that it was worth 20 points* In Advanced American Literature she 
reminded the class that despite the fact that people were now reading 
different novels they would all get points for the first parts of t%«o novels 
they had read together in class as long as they completed the assignments on 
them* Also in that class in one of her more exasperated outbursts^ she 
threatened to give O's for every day that students didn't bring their books to 
class and have something to do* 

G* Evaluating instruction 

This teacher is very tuned into pacing her instruction to ensure that what 
is being presented is appropriate and meaningful for the students so that 
learning takes place* Consequently, she is constantly adjusting^ checking 
progress^ revising timelines^ reteaching when something isn*t clear or they 
just didn*t get it^ or simply doing the assignment over together in class* 
She determines the need for this based on various types of assessments — oral 
questions in class, bciBework and class-time assignments, and tests* For 
example, by looking at the assignments being turned in she decided that both 
of the Advanced Composition classes were having difficulty with the passive 
voice (the subject of the assignment)* Students were on-task and putting a 
lot of effort into their workr but they just weren^t getting it* So she 
decided to spend more class time on it* (She Celt it necessary to encourage 
them by saying that she would give them credit for what they'd done and then 
help them improve it*) 

There were also many times when she adjusted the pace of her lesson plan 
to £it the progress oC the majority or£ the class* This seemed to occur a lot 
(because many students hadn't done the work at home)* This may have been 
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detrimental to students who were conscientious about the assigned work* In 
some cases she did try to give those students added stimulation, but clearly 
needed to move the group along more or less together f despite the potential 
for boredom on the part of some* (See VI«C« Tiioelinessr for more on this*) 

Perhaps the clearest indication that she uses assessment to evaluate 
instruction (and achievement! of course) occurs when she postpones a test if 
the students aren't ready to take it* This happened in the Advanced 
Com^ sition classes (when she found she needed to reteach before they were 
realty for the test over the chapter) and in the Advanced American Literature 
class, when small groups of students did not complete their readings as 
quickly as anticipated and she put of£ the test until they were ready* 



H» Communicating achievement expectations 

In a sender all types of academic assessments communicate achievement 
expectations^ whether the teacher overtly intends them tc or not* The nature 
of a teacher's oral questions^ study questions and assignments^ and tests**all 
give students clues about what is expected of them* I saw very little overt 
use of assessment to communicate achievement expectations* Once she said 
**you'll need to know this for the test*** There was, however^ one very :;lear 
exaunple of assessment used in this way* The teacher told me about a test on 
MacBeth she had given in the Advanced Senior English class during the first 
half of the year on which everyone did so poorly that they were devastated* 
There was one A and 14 D's* It was clear to her that they hadn't studied 
enough* So she decided to give them a second chance to prepare^ She wrote 
another test, the students studied very hard, and the results were much 
better* They knew what was expected of them* 



I* Communicating affective expectations 

As noted in F* abover this teacher prefers to use nonverbal ways to 
communicate affective expectations* However, she does use oral question 
targeting to control or draw attention to unacceptable behavior* She also 
uses oral or written comments and grades to reward acceptable behavior (beyond 
the quality of the work)* For example^ I saw several papers wh<!re she had 
made «n encouraging comment to a student who had obviously not participated 

regularly in the past* For example^ **I hope this is a sign t you are going 

to begin to participate, (name)r** or **This is so well done that it would be a 
pleasure to have you here each dayr (name)* Can you manage to join us?** In 
class she might orally reward a student who had previously been off task by 
noting that he or she had finished or had a good answer* 

J* P roviding test-taking experience 

Other than initial tests in a new class which allow students to g<!t to 
know the teacher and her expectations (and which I did not observe) r the only 
time this teacher used assessment for this purpose was in her two Advanced 
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Composition classes when she gave them the Simulated t€5t of Standard Written 
English (TSWB) and then vtent over it in class as a way of preparing them for 
one segment of the SAT^ which scxne would take in the future* (The TSWE is 
taken from Improving college Admission Tfest Scores — Ito Develop Cognitive 
Skills and Test Familiarity * Verbal Workbook *) 

K* (See form) 



Additional Coaunents 

Another purpose of assessment — not on our list — for this teacher is 
accountability * Although she has very little contact with parents at this 
school (especially compared to the previous school where she taught)^ she 
remarked that she keeps a oolumn in her gradebook for class 
participation/reading aloud (etc*)« mainly for the benefit of parents and 
administrators (but iiq»lied in this was that she used this assessment herself 
but did not need the concrete scores for her own ratings as much as to justi^ 
grades to parents and administators** *) * 

Teaching thinking <or reasoning) skills was another assessment purpose 
that arose from discussions with this teacher* She uses assessment to teach 
kids to think and pull things together — particularly in essay tests or 
assignments* she often does open book essay tests in which she* 11 even help 
students find a particular spot in the book if they whisper the content but 
just can*t find the places because she is primarily interested in having them 
learn to use ideas and present them coherently* 



II* ASSESSMENT METHODOLOGY 
A* Assessment of achievement 

1* Teacher-developed paper and pencil tests and quizzes 

This teacher prefers to develop her own tests and quizzes^ particularly 
for her literature classes* When asked if her training had prepared her for 
the kinds of assessments she does in her classes^ she laughed and said 
"^Absolutely not!"* she then went on to say* homver^ that her Methods course 
was really pretty good (20 years ago?)^ but there was no sustained training* 
She feels teachers should share materials and methods and she tries to do so 
with younger teachers* As a seasoned English teacher (who was the chair of 
^ the department at the school where she taught before) « she developed the 

screening test that her present high school uses in the feeder schools to 
determine who will be placed in accelerated English classes when they enter 
high school* She and the acting head of the department and another teacher 
independently score the results holistically* Her training 1' holistic 
scoring consisted of learning from an art teacher who was an Achievement T^st 
0 reader at the school where ohe taught previously^ and attending a workshop at 

a local college taught by her old Methoos teacher (a reader of SATs}* 
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With regard to her own classesr in developing a test she says she tries to 
have s<xnething for everyone: some one^word answers^ sane essays, some easy 
questions and some opinion questions. Also, she always tries to weight the 
test up frontr so that if the clock runs out the slow ones or the ones who use 
up the whole time and try to do a really good job won't be punished. If it's 
a big testr she may spread it out over several days. She may do seme of it in 
class and assign some as a take-home test. (See previous sections for other 
ccmments re open-book tests and retesting if results are bad.) With regard to 
test design she notes^ "It is high school — I always have some paddingr (some) 
easy questions. For literature classes essay questions are her preferred 
assessment methodr although she uses a combination a types of questions as 
noted. 

Beyo.id the above conslderationsr how she judged the quality of her tests 
wasn't clear* Using the Advanced Sr. English MacBeth test (referred to above) 
as an example^ when the results were so poor^ she didn't say it was a bad test 
or it was too hard. She said the students weren't prepared. She wrote 
another testr the students studied again , and they did better. (It would have 
been interesting to compare the two*) In the saiAe class she also noted that 
they didn't do as well as she expected on a test on Gulliver's TraveJ.s and she 
was "mad" at them* (These two tests were from the third quarter.) 

It is difficult to say how often she tests* She gives tests after 
completion of chapters in Advanced Composition^ or after completion of a novel 
or a group of short stories or a "unit" of satire selections or poetryr but 
the timing is not regular. She doed not test routinely once a week^ for 
example. Bather r she allows the pace of learning to determine the timing of 
the test^-and as noted abover she is very flexible regarding the pace and will 
postpone a test until the students and she think they are ready* Her 
gradebook for last quarter indicates that study question:: and assignments far 
outnumber tests in all of her classes (usually about two major tests per 
quarter) . Tests tend to be major reviews or con^arisons and are usually worth 
approximately three times the points of other graded activities, and each big 
test seems to be about 1/6 of the total points for the term, although the 
pattern is not clear cut* 

2. Text-Embedded paper and pencil tests and quizzes 

She prefers not to use these and rarely does* In her literature classes 
she writes all the tests and quizzes. In her composition classes she may use 
some text*embedded tests — in general she said she made all her own testsr but 
then later mentioned the composition book's suggestion that a final test on 
vocabulary be given at the end^ which she planned to do; it wasn't clear if 
that was a text-^bedded test oi: her own. 1 never saw the composition chapter 
tests, unfortunately. 

3. Performance assessments 

This teacher is continually assessing her students' performance (via oral 
questions and their written work}^ but rarely in the forn^al sense of this 
term. One example of formal performance assessment is when students read 
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aloud in class (as in Advamced Senior English when the class was reading a 
play) and she might mak^ a mental or written note regarding their reading to 
include in her "class participation" column in her gradebook. But this forms 
a very small part of her assessment procedures in her literature classes and 
the quality of their reading is not as important as their participation. 

The writing sample which she requests at the beginning of the school year 
is another example of formal performance assessment (see I, A, above). Here 
she is clearly assessing the students* writing skills. In literature 
assignments and testSr however r she primaurily assesses contents although 
grading essays can be rather subjective and skill in writing obviously might 
tip the balance for a better grade. She seems to be aware of this, however. 
In the daily papers I saw she gave the same h^^h grades for short as for longr 
elaborate answers if the content was correct, (As notedr she no longer grades 
on technical worth of the writing, though she still notices it,,,) 

In the Advanced Coo^sition classes, the subject lends itself to 
performance assessment, I did observe assignments in which the point was to 
write "an essay" and the components of what makes an essay had to be present 
for the student to receive a good grade, 

4, Oral questioning strategies 

Oral questioning plays a very big role in her daily teaching and 
assessment of progress. She may start out a class session by doing what she 
calls a "reality check," finding out where people are on the assignment by 
as!,ing the group as a whole and by targeting individuals. She will ask if 
they finished, how far they got, and then specific questions based on the 
assignment, (She gets amazingly honest answers re progress on the 
assignment,} By this time in the term she has identified topr middle and 
bottom students (based on previous performance/achievwent) and will use this 
knowledge to target students to judge if the class is doing the work and 
understanding it. 

Linked 'to this way of assessing progress is her use of oral questioning 
during the instruction. She uses oral questions very skillfully to guide 
students through the material (particularly in the liter'^ture classes) r 
starting with straightforward plot questions (recall) ano moving easily into 
more thought^provoking questions about the interactions and feelings of 
characters in the work and the significance at the time it was written and 
now, (See 13 belOw re the cognitive levels of her questions,) Oral 
quostioningr thenr is c>bviously a teaching tool which she uses well. But 
while she is teaching she is also constantly assessing with this strategy. 
Although she relies a lot on spontaneous responsesr she targets individuals 
frequently. She att^pts to get most of the students involved r but is not 
always successful (in part because disrupt^v., students require her 
attention)* Begarding her delivery of orax questions^ she is \ery 
skillful»waiting for a response^ probing to get the student involved^ 
encouraging and guiding when the answer ifin*t quite right, building on a 
student's answer and thus encouraging more involvement and ownership of the 
discussion. She doesn't always supply the answer r but looks £or another 
student to help ov;.. The pace is lively^ however r and she supplies 
explanation when necessary. 
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Except for her column on reading/class participation (with pluses or 
blanks as grades), she doesn*t keep written records of the assessments she 
conducts via oral questioning* 

When asked about her preferred assessment methodsr she replied that oral 
discjs^ion with small groups of students (no more than 6) coupled with 
individual essay writing was the best (and most fun) way to determine what a 
student knows* X observed her use of this combination in her Advanced 
American Literature class.> 

5* Standardized tests 

This teacher feels standardized testing is not useful for teaching English 
(her main focus is literature}* She noted that the SAT is valuable (for 
college placement), but she stressed that students couldn't really study for 
it in a brief period of time* She has tried to explain to parents that it 
isn*t useful to cranes kids' heads full of vocabulary in preparation for the 
SAT* The test is much more than vocabularyr it is a matter of life skills and 
experience* Students from nonreading environments are at a real 
disadvantage* However, she doei? use t^.2 simulated liest of Standard Written 
English (TSWE) to help prepare students for the SAT* The district distributed 
this to all the schoolSf but she didn*t know they had it until she came across 
it in the library this year* Unlike the SATr the TSWE tests only seven or 
eight things and she can teach them all* During my week of observation in her 
classes, she went ovei; the TSWE in the two Advanced Composition classes to 
prepare students* She noted that the scores of students who had alrea^ taken 
them were not goodr the highest score was only 24 out of 50* She also 
commented on the declining levels of SAT scores* remarking how different 
things arc noW"One taurely sees a score above 7L'^ or even in the 600s* Thusf 
she seems to be using the results to generalize about the level of students 
she has today, even though she feels that such standardized teste are P^t 
useful in her work* 

She also noted that once in a while it is usetul to refer back to 
individual students* scores, giving the example of a boy who had puzzled her* 
She wasn't sure why he wasn't doing the workr but found that he had done mil 
on the standardized testr so she knew he was bri<fht"it wasn*t a question o.^ 
ability* 

6* Group assessment methods 

X did not observe any group projects in which students worked together for 
a grade* The teacher mentioned one instakice last quarter in Advanced American 
literature when they did TV panels — but the only credit they got was a check 
in the gradebook* 

7* Opinions of other teachers 

This appeared to enter into her assessments very seldomr though I suspect 
she uses this type of infonnat^jn when she gets it* (X did not discuss this 
tof^ic in interviews >rith her*) She does eat lunch in the teachers' lunchroom 
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and has contact with other teachersr so she has access to the opinions* 
Since she believes in sharing materials and methods r it i3 likely that 
exceptional students (problems or outstanding students) are a topic of 
discussion from time to time* My presence obviously inhibited rome of the 
normal lunchtime conversation* Teachers did talk shopr however^ as well as 
socialize* 

On one occasion she did mention to me that she knew that a boy who had 
been doing very tittle her classes and had begun to partic^^ te was also 
doing little work in other classes* (She was pleased to Sce him begin to tune 
in*) 

8* Assessment of reasoning skills 

As noted earlier^ helping students learn to think and finding out how what 
they*ve learned has changed their thinking is a major part of thir ,dcher*s 
purpose in teaching and in assessing* Whether or not she uses a 
consciously -defined taxonomy in selecting her questions is unclear* In 
practice, however^ she does build from recall questions to questions requiring 
higher level thir^^i^g skills and uses a variety of types or levels of 
questions in all aspects of assessment, oral questioning, study questions and 
tests* (See 4 above and 9 and 13 below*) She notes that she herself is a 
synthesizer, that 8he*s not good at recall, but she uses recall questions to 
get the students through the material* 

9* Regular assignments 

Assi iments are a major part of daily classrocm activity^ both in the 
literature and in the ccraposition clasces* In the Advanced Senior English 
class and in the Advanced American Literature class the teacher always writes 
her own study/discussion questions* In the ''regular'* American Literature 
class (whioh she considers to be at a very low level) she selects questions 
from among the questions in the text of short stories they are currently 
using* When X asked the basis for her selection of certain questions and not 
others she replied that she was trying to turn these students into readers* 
In some instances the questions were too hardi in others she didn*t want them 
to spend more time on the topic* The bottcn line was that she didn*t want to 
curn them off* She feels that in this class they may have read more than they 
ever have in their lives and she wants to encourage that* 

When it comes to homework, she says students at this school ^are bad*^ Of 
the sophomores she doesn*t ask for more than 30-^40 minutes daily and only 
assigns them reading as homework* In her **regular^ American Literature class 
(her lowest class) she only expects about 20 minute^i of work outside of 
class— they're suE^sed to be reading a book beyond the class-time ,K>rk* In 
her writing classes^ most of the work is done in class because she likes to be 
there to help and provide instant feedback* If the students worked hard in 
class they'd have little to do outside* During the wee!c I observed^ she 
followed this pattern, with the exception of the Advanced Senior English 
class* There she assigned more homework^ including a take-home test* She was 
less explicit with these students about the "assignmt^nt^'-a pattern of working 
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independently on the study questions once they were handed out seemed to have 
already been established* However^ at one point even the 'tcf)" student didn*t 
realize that she wanted the answers to sctne dictated questions turneO in* The 
teacher expects students to take responsibility for their own learning* 
However^ she feels a little disappointed in these seniors"it*s the first time 
she*s had seniors who jusi: don*t work very hard* 

In all her classes there were almys numerous students who hadn*t 
coinpleted the assigziment^ and in almost all the classes she then gave time in 
class to get it done* She expects students to do their own work^ but feels 
it's important to encourage peer collaboration (rather than competition) "to 
get than involved and talking about the subject* Because papers trickled in I 
never saw a complete set from any class* The random bandfuls I did see were 
graded with just a nuubei: over the total possible and an occasional 
encouraging comment* On essays and short answer questions her method of 
assigning points is not spelled out^ except that she reads what she expects to 
be the top and bottom students* papers to get an idea of how things are going 
to look* she notes that she is not infallible and recognises that her grading 
nay vary slightly after reading a lot of papers r so she is always willing to 
reread a paper if a student requests It* (This almost never happens*) 

10* Student peer ratings 

She does not use this method exccot informally when she encourages 
students to help each other or improve on a student's sentence or answer ? The 
Ofily other time I saw this was when she escpressed exasperation after class 
about a student whose only contribution to class was an empty coke can^ and 
another student commented about that student's lack of potential for college* 

11* Sttxlent self ratings 

Since her philosophy of teaching is to give the students responsibility 
for their own learning^ she encourages theis to lock in the gradebook and 
evaluate where they are and what they need to be doing* Other than that^ I 
did not observe her overtly asking them to rate themselves on work (except the 
occasional "How are you doingV*)* She noted that two students had dropped out 
of her Advanced American Literature class to take a lower level class because 
they bad decided that they were non-*readers* 

12* (See form) 

13* Cognitive levels of questions posed 

(See form) Of interest here are the differences between levels of 
questions posed in literature classes and questions in composition classes* 
The grammatical content of her composition classes causes them to have mure 
recall and analysis questions and far fewer comparison^ inference and 
eval^iation questions* Literature^ on the other hand^ lends itself well to 
higher order thinking questions* 



Note: Scute of the oral questions '^ere reviews of text or study 
questions* Alsor literature tests and quizzes are under -represented since 
during my observations thete was only one literature test and one 1-question 
quizr whereas two ccnposition tests were given and reviewed. 

14* Strategies for integrating assessment and instruction 

As noted in section II*A.4* abover this teacher relies heavily on oral 
questioning as an instruction and assessment tool and is extremely skillful at 
weaving the two together* However r her lack of recordkeeping on such oral 
assessments makes this integration less than ideal* Another way this teacher 
integrates assessment and instruction is by orally correcting or reviewing 
assignments and tests in class* She uses this often as an instructional toolr 
especially when the results of an assessment indicate students are having 
problems with the material* I did not see peer editing usedr except 
informally (peer oollaboration) * As noted previously^ in the composition 
classes she did use the 1!SW£ as a practice for real test-taking and went over 
it item by item in class as mil* 

15* Dealing with cheating 

I saw little evidence of her overt strategies for .dealing with cheating* 
In one class before the test she said, "Okay, test-taking position^" and kids 
straightened around in their seats r but in another she actually left the room 
during part of the test (was this because I was theire?}* I did see students 
turned around and even talking during tests* (Itie atmo^here implied that 
these were not very serious tests*} 

Plagiarism: She is amre of this as a problem* Becall that she keeps 
writing samples on file in for later review of students^ command of the 
language* I observed an instance when she asked a student to bring in the 
books he had used as references for a i^r^per * She conmiented to me that there 
was no way that the ideas in that paper were his* Unfortunately, the books he 
chose to bring in were not the ones where he got the ideas* I observed one 
instance of copied work on an in^class assignment. Two boys' papers on "a 
personal time of change^ were almost identical* In these cases she would talk 
to the students and give them a lesser grade* 

B* Aggeaament of affect 

1* Observing individual students 

Gy this time of the yearr this teacher has clear ideas about her students* 
behavior* The teacher seems to be genuinely interested in her students as 
individuals and to consider theu as such* Many times in discussing the work 
of Btudents she would explain to me the family circumstances that might be 
causing disruption in the student's life at the time, for example, and thereby 
causing a certain behavior problem* (However r she is not a teache:. who gets 
heavily involved in the lives of her students outside of class* 'ihe has 
decide:^ that the school has other personnel whose job it is to do that*] 
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It seemed that moat of this teacher's problems in teaching related to the 
social behavior of her students* Some days she would throw up her hands in 
disgust* otUer days she would sarcastically comment about the environment In 
the room — ''lost It agalnr huh?** when the noise level went from that of quiet 
concentration to restless chatting and teasing; ^peacer peaces peace^j ''maybe 
we should try music** (to calm than)* As notedr she used oral questions to 
control seme behavior* Because her classes tended to have such short 
att ntion spans and tended to display disruptive behavior frequently, her 
approach to It was primarily reactive r responding once the noise level had 
reached seme intolerable state or a student had gone beyond sane limit 
(defined In her mind and at least somewhat in the minOs of the students — they 
seemed to know when they w^re out of liner though a few continued to challenge 
or be sassy)* In this sense^quieter, troubled students get less attention in 
class (because of the necessity to control the class) ; however r she give^ 
serious thought to her students, their workr and their behavior* She holds 
many mini^conferences with individuals — during class when students are working 
at their desks and after and before class* 

On occasion she filled out a Student Warning Slip to send td the office, 
for example^ if a student was continually tardy or never brought his book to 
class* This slip would caufi:i a note to be sent to the parents* It seemed she 
kept these slips for a day after filling one out to see if the pattern 
continued* On one occasion when the student did bring his book the next day 
she encouraged him by saying that she was going to tear up the slip (he didn't 
even know she had filled one out)\ Another time she noted to me that a 
student was really trying since she had sent a warning slipr so somebody must 
have talked to him* 

Affective traits that she considers (based on my observations and our 
conversations^ but not based on direct questioning of the teacher): 
motivation and Interest {as seen in attendance and tardiness—big 
problems 1— and in class participation and wllllngnega to do the lork ) ; 
discipline ( concentration ^rA application to the work )? respect (for the 
teacher and the class) ; disruptive behavior (loud talking or shouting, 
physical activity In class such as running^ shoving, throwing thingsr etc*)* 

She has well defined performance criteria (regarding affect), but it takes 
several days in her class to become aware of this* She notes that she doesn't 
maintain a reaMy tight ship because she thinhci a restricted environment would 
not help these kids learn* Except for her checks in the gradebook regarding 
class participation and occasional notes to herself or warning slipsr she does 
not keep good concrete records of her assessment of affect* She has taught 
for so many years that her experience has shown her that she is a relatively 
good judge of behavior (this is my sense of the situation)* 

2* Observing grc interactions 

Group interactions clearly give her clues to individual affective traitsr 
especially early in the year «or term* In her classes there were many small 
group Interactions going on daily (usually the same participants)* An example 
of what she inferred from these is ner comment on two girls who have not 
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performed well and usually sit together: One Is doing much better now^ does 
perfectly acceptable work when she settles down. She does fine when the other 
girl is not around^ so she*ll probably be okay if the other one doesn't come 
back to class. (The other has done nothing at all in class.) The teacher 
goes on to note that of course it sccaetimes works the other way around too; 
the girl who is settling down could have a positive influence on the other. 

3. Using questionnaires 

I saw no use of these. 

4. Using interviews (formal and informal) 

As noted above, this teacher does meet often with individual students '.n 
mini^onferences to discuss their performance and behavior^ and sometimes to 
discuss the quality of their work (achievement). I'm not sure if she tries to 
do this an equal number of times with each student. It seemed to me she did 
it more with problem students^ next often with exceptionally good students^ 
and least often with average students. She remarked to me that she felt an 
English teacher could often do more than a guidance counselor for a 
8tudent**^ut this was in the context of helping a marginal student think about 
planning and choice of classes^ rather than specifically about behavior. 

No use of formal interviews was observed or discussed- 

5. Opinions of other teachers 

I saw and heard very little about the opinions of other teachers regarding 
affects though I know they talk in the lunchroom and there I heard other 
teachers conment about the behavior of specific students. 

6. Opinions of other students 

The teacher asks students where someone is or what*s the matter with the 
absent student (while taking role, for example). Students know by now that 
she is concerned for thc-ir «^lfare« I did not observe her gathering their 
opinions^ but I do know th^t she occasionally uses "the grapevine* to get a 
message about behavior to a frtudent. I see no reason to think she wouldn*t 
gather information that way^ too* In^class interactions when students police 
their peers also give her inforitiation about individual students* behavior^ 

7. Opinions of parents 

She notes that there is precious little contact with parents at this 
school (especially when compared to the parental involvement at the school 
where she preriously taught "involvement chere was excessive). One instance 
of paurental contact during isy week of observation: A mother wrote the teacher 
a letter recognizing that her daughter was having difficulty in school and 
might not graduate and asking the teacher to help her mako it through. This 
letter was in response to a failure warning slip <}ent heme. The teacher feels 
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that the girl is not a bad stu<3ent; if she will just atten<3 class an<3 tryi the 
teacher is willing to find a way to get her through. This will require 
special attention^ because there is no way the girl can make up the many 
assignments she hasn^t done along the way, 

8, Past stu<3ent recor<3s 

I foun<3 no mention of looking at past stu<3ent records (other than 
screening tests) regar<3ing stu<3ent behavior. The teacher has ha<3 seme of 
these stu<3ents in other classes in the pastf in which cases she has personal 
experience with their past recoras ana it appears that they ao, inaeed^ 
influence her assessment of their behavior, 

9. ana 10, {See form) 



C, Assessment of ability 

Ability per se aces not seem to be of major importance to this teacher. 
She says stuaents aon^t have to be brilliant to do well in her classes. 
Willingness to try is more important to her than ability. However^ she aia 
occasionally use the term **able** or **capable** to aescribe stuaents. Ana she 
often commeitea on how her teaching at this school was necessarily on a lower 
level than it haa been at her previous school, (Wliether this was ability or 
achievement or both is aifficult to aetermine,) 

In trying to identify how she measures students* ability ana how it 
affects her teaching^ it is sometimes hara to separate ability from 
achievement.. Affective factors are also entwined in this issue, W}.en she 
says that she knows what a girl is capable of based on having had her as a 
student in a previcHis class^ she is probably measuring a combination of 
ability^ achievesDoit ana affect, {In any casei her assessment was accurate: 
When given a secona chance the girl went from a D to an A,) When she 
complains that the thira quarter graaes for the regular American Literature 
class aon*t reflect their abilities^ how aces she know what they are capable 
of aoipg (as separate from what they have been willing to ao)? When she talks 
about certain inaiviauals ab L^ing very capable, what tips her off? Scnie of 
the first clues £or her eure humor or sparkle, a quickness of mina^ a spark of 
interest ignited. Is she thinking in terms of ability when she remarks that 
you can*t teach critical thinking skills to everyone?*-with some students you 
simply cannot explain why a basic statement is illogical^ but with someone 
•quick** it's easy. 

Her sense of students' ability does influence her teaching. She makes a 
special effort to meet individual students' needs (even though it complicates 
her life as a teacher considerably). She individualizes her instructional 
objectives and strategies as much as possible. She groups for instruction if 
it can be done within the parameters of the lesson plant meeting separately 
^ith students who are farther ahead in their reading or providing extra 
assignments and outside time for exceptional students. Her methods for 



measuring achievement may be flexible too — recalls for exanqpler the girl she 
was willing to help finish school even tliough she wouldn't have fulfilled all 
of the requirements* She also notes that F*s usually mean that the students 
didn*t c<^e to classy if they attend she can usually get them through* Her 
grading standards vary alsor as reflected by the case of the girl whose grade 
in the advanced class was equivalent to a better grade in the regular class 
where she should have been placed; the teacher got the grade changed. She has 
had to lower her expectations for her Advanced Senior English class (and 
consequently her grading standards) compared to classes at that level in other 
years* 

^is issue is complex and often unclear* She sadly remarks on the 
declining SAT scoresr attributing this to a decline in the reading the public 
doesr rather than to a decline in abilities* Yet she looks to the results of 
standardized tests tidten she is really puzzled about tidtether a student's 
performance is due to lack of ability or some affective factor* 



D, Text assessments 
(See form) 



III* CRITERIA FOR SELECTING ASSESSMENT METHODS 

A., B* and E. Results fit purpose^ method matches material taught, and origin 
of assessment 

This teacher does this intuitively* The best exai&ples are when she 
selects only certain questions from the text-embedded questions or prefers to 
write her own entirely* (However^ there are several reasons for writing her 
own — freedom to choose a wide variety of books for tidtich assessments are not 
necessarily available^ many years o£ experience writing assessments, 
preference for her own way of guiding learning via assessment*** I am not 
sure if she bothers to find out what assessments are available for the 
literature she selects, unless it happens to come vith the edition she has*) 
Since her major purpose in teaching, especially in literature^' is to get the 
students thinking^ she prefers assessments (whether oral questions^ study 
questions or tests) which help her see how their thinking is progressing* 

Her methods seem to match the material well* In her cos^sition classes^ 
which are currently focused on aspects of grammar and writing style, she uses 
the text questions r which call for recall of points of grammar and stylistic 
terms and samples of writing* Her literature class assessment methods are 
specifically designed to assess recall of the materials readr analysis^ 
inference and evaluation of themer etc*r and comparison among works* 



C* and D* Ease of development and ease of scoring 

Ease of development does not appear to enter into this teacher's 
assessments* ^e fact that she provides variety to her students by allowing 
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them to choose from ntemy different books to read, all of vhich she too must 
read and for a^ll of. which she writes study questions and tests r is ample 
evidence that ease of development is not foremost in her mind* She admits 
that it might be a factor occasionally r depending on outside circumstances* 
She takes ease of scoring into account more frequently, although the number of 
short answer and essay questions on both her study questions and her tests 
belies this concern* She notes that in the interest of sleep and energy she 
sometimes has to do things that don't take a lot of time to grade* She uses 
holistic scoring on writing^ andr as noted, has stopped scoring technical 
writing mistakes* 



F. Time required to administer 

This is relatively unimportant* She seems so focused on making sure that 
learning is going onr that she is extremely flexible about the time it takes. 
Ct>r exanqpler. if necessary^ she may spread a test out over several days. (A 
separate^ but related issue is her willingness to put off administering a test 
until the students are prepared so that they really have a chance to show what 



they know.) 



G* Degree of objectivity 



Very little was said about this. Her questions and tests reflect a 
concern for facts as well as interpretation (combining reca.M with other types 
of questions}* She remarked that wl:en they were stu<^ing Shakespeare last 
term she was a stickler for textual proof of what they thought, "no wild blue 
yonder theories*" However^ the way she assigns grades often requir^^s a great 
deal of teacher judgments thus lending itself to a more subjective basis for 
gr ading* 



H. Applicability to measuring thinking skills 

As noted on' several itenis here, this is of top priority with her* 

I* Effective control of cheating 

She se^s to feel that she knows what they can do and so can tell when 
they've copied* (See examples under XI*A*15* above*) X think she would 
prefer not to have to be bothered with this issue* She prefers a 
collaborative learning environment^ but recognizes the n^ed for individual 
assessment. At least on daily assignments she is rather cavalier about 
cheating^ I th^.nk* Since X only saw a few testSr I*m not sure Ikow strict she 
can be* The testing environment I saw was not very strict. 

J* (See form) 
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IV* QCJALIIV OF ASSESSHEKTS 
(See foiH} 



V* FEEDBACK PROCEDURES 
(See form) 

Itotes It is sofnetimes (!^^£^cult to separate feedback regarding 
achievement from feedback about affect* TUe importance of this differmce is 
reflected in the percent of oral and nonverbal feedback focused on achievement 
compared vith the percent of written feedback focused on achievement* The 
disrpptive behavior that goes on in this teacher*s classes requires that 
oral/nonverbal feedback focus more on affect than does writtm feedback* The 
classroom environment also affects the amount of positive feedback given 
orally* This teacher is very positive and encouraging in her comments about 
achievement (though she vill say vhen something is vrong)* However^ much of 
her feedback (both oral and nonverbal) in the classroom is negative (even if 
subtle^ sarcastic or humorous) because the students' disruptive behavior 
d^nands her attention* Thus^ overall^ her written feedback tends to be much 
more positive than her oral feedback* In writing she often tries to add 
encouraging comments* 

Regarding use of samples of performance as feedback: She occasionally has 
a student read an answer as an example* I couldn't discern any pattern re 
choice of student (it wasn't always^^-or ever?~ the top or bottom students) r 
as this didn^t happen often* More often she would mention the names of 
students who had completed their work or were at the point everyone should aim 
for* 



VI* DESCRIPTION OF TEACHER AND ASSESSMENT 

A* Tleacher^s background 

niis teacher started teaching at this school in 1964 and taught here until 
1973 f when she had to take a 1^*1/2 year leave of absence due to illness* She 
resumed teaching in 1975 at another high school (which serves a more affluent 
community of students across town)* She taught there for 10 years^ rising to 
be the Chair of the English Department* Two years ago she returned to teach 
at the high school where she teaches currently* (See II*A*1* for more 
information about her training*) 



B* Teacher's expenditure of time 

She spends 16-18 hours per week outside of classr not counting exam 
prepaurations* She comes in before 8 a*m* and stays until 4 or 5 P*m* dailyr 
never works on Saturdays^ but does usually work part of Sunday* (For other 
details of A* and B. see form*) 
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C* Tfeacher characteristics 

I have conunented on many o£ these topics earlier* 

This teacher definitely sees herself as a curriculum maker and presenter* 
However r she does believe in departmental consistency and continuity with 
regard to curriculum* Therefore^ when she returned to this school last year 
she consulted with another member of the department so that she could give 
sosae coherence to the English curriculum* (She laughed as she ranarked that 
not everyone does that and gave the example of a 21-year-old teacher who once 
taught Moby Dick for the entire year because it was his favorite bookl) 

She seems to have considerable freedom to choose materials (especially 
supplementary materials)* She noted that in her regular American Literature 
class they had done Death of a Salesman f even though she knew that it was 
usually done in the advanced class r because she was sure that those kids would 
never get to that level (assessment?!) so there was no concern for 
duplication* She has very high expectations of herself as a professional* 
Sometimes it sounds as if she would really like to work with more motivated^ 
harder*working kids* On other occasions she seems very dedicated to turning 
these kids on to the enjoyment of literature* In either caser she is very 
professional about her role in the process* 

High quality performance i She is not rigid about the correctness of 
responses r unless dealing with a point of grammar or a fact of a plot* In her 
literature assessments^ she allows for variation of interpretation at times* 
For example^ last term on the Advanced Senior English test on Gulliver's 
Travels she scanned through the tests to see what she had before grading and 
found variation on what Gulliver represented^ so she decided to accept a 
cluster of interpretation^* 

Her view of her students is only stereotypic when she globally compares 
them with the students at the hig*^ school where she taught before* Otherwise 
she seems very aware of individual personalities and outside circumstances* 

Performance norms : She seems to have very clear , but unwritten and pretty 
much unstated performance norms* 

Hxper inten tat ion i She is very open to trying something new* She is very 
pleased that having the Advanced American Literature class work on so many 
different novels simultaneously is working out so well* It was an experiment 
and she wasn't sure it would work with this groupr but they are handling the 
rather independent individual and small group work well* 

Orientation to cheating ^ As noted , she do^s not seem very concerned with 
cheating* She did ranark that she is more careful with "announced* tests and 
does not return them until all maUce-up tests are done* (However r she does not 
change the test for the make^Hjp*) She also noted that on regular assignment 
papers turned in late she sometimes sees that someone copied from a paper that 
bad already been handed backr but she goes on to say that she has too much to 
keep track of and can't always remember what's been turned in* 
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Amount of cheating ; I*m not at all sure how much cheating goes on — I saw 
few tests or papers during the week of obeervation. And her tolerance of a 
noisy classroom (with lots of off^task behavior) and her encouragement of 
collaboration on daily assignments made it difficult to define ''cheating" 
regarding daily activities. 

Value of progiptness and timely work completion ; As previously noted, in 
her classes the assignments drag on and trickle in. She herself remarked that 
she receives "endless late papers." She grades on the nterit of the piecei but 
puts a box around the score in her gradebook for any work that is turned in 
late. At the end of the quarter she can see at a glance the number of boxes 
(late papers) a student has and she will take that into consideration in the 
final grade. In class she publicly announces whose papers are still not in 
(though it didn*t seem to phase the students)- 

Interpersonal environment of the classroom regarding assessment ; As 
notedf she prefers a collaborative environment. She notes that in this 
country our heavy emphasis on competition keeps us focusing on individuals. 
She thinks a better learning environment is achieved when students ace 
encouraged to help each other. She had discussed the differences between 
classrooms in Sweden and in this country with the school *s Swedish exchange 
studentf who explained that in Sweden when kids finish a task they help 
someone else. There a lot of cooperation takes places a lot of kids engage in 
discussing the subject or taskf and students feel "good vibes" re helping or 
getting help from a peer. She chuckled when remembering how teachers at the 
other school where she taught thought th^ Southeast Asian kids were cheating 
when they helped each other on a test or task. 

Reasons for student success or failure ; Her definition of success would 
be to turn her students on to the enjoyment of good literatures she's not 
looking for English majors. However^ in this school she knows she's mightily 
challenged to meet this goal. Host of her students do not come from "reading" 
hemes. 

She does not take the responsibility for success entirely on herself. Her 
stated philosophy is that the students are old enough to be treated like 
adults and therefore are responsible for their own learning. I think that 
since she has the confidence that she's a good teacher she would attribute 
most of the responsibility for success to the student. Success can also be 
measured (and usually is) in terms of a passing grade. Her power and 
influence ever success or failure by this definition are evidenced by her 
statement that if students have been placed properly and if they attend classf 
."ihe usually can get th^ through. 



VII. TEACHER'S PERCEPTIONS OP STIIDEKT CHARACTERISTICS 

As noted, in general she has decided that students at this school are not 
very motivated or mature and therefore do not perform at very high levels- 



ERIC 



163 130 



Their study skills are nearly nil in many cases* She tries to encourage 
independent learning and responsibility for one*s own progress, but finds that 
she has had to lower her expectations and monitor^ encourage^ spoon feedr and 
prod students farr far more than she has had to in the past* She feels that 
her students' feedback needs are greater than before and she has had to give 
points and credit for everything* {This seems a bit contradictory to the lack 
of Interest observed ^monq students regarding completion of work and response 
to feedback vrfien they got it*) 

Sense of fairness : She says the students know she* 11 reread a paper if 
askedr but they almost never have requested it* I did not have much 
opportunity to talk with the students themselves* The atmosphere in the 
classrocnn (although often noisy and disrespectful) seemed to be accepting of 
the teacher's authority and knowledge regarding the subject beinc taught* 
Alsor at lunch one day another teacher passed on a ccmplinient to this 
teacher* J^paiently she had overheard a student talking about a really goodr 
conscientious r hard-working teacher and it turned out to be this one* 

Iteaction to testing ^ She feels students in this school are very blase 
about tests* Again she compares them with students from the other school* 
Therer at finals time kids would be cramming in the halls even* Here, the 
atmosphere in the halls is hardly different from any other time of year and 
some students will even arrive in class and ask ^^at are we doing today?*' or 
arrive at the wrong time to take an exam* I observed a few students reacting 
with sani^nic when they mistakenly thought they were being given a test 
(unannounced)* In another class at one point she assured the students, ^'This 
is not a test, just study questions**' Once a boy conmented that he was very 
bard on himself in testing situations and she remarked that she thought one 
needed a certain balance between relaxation and tension to handle tests well* 
She gave me the example of a Vietnamese student who she thought had the 
appropriate amount of tension and responded well in testing* 

Parental expectations ^ Commented on above* Her comparisons of the 
excessive involvement of parents at the other school {^'always beating do%m 
your door*' to argue about a few points, even though they said they weren't 
concerned with grades) and the dirth of par«ital involv^ent here highlight 
the influence parental involvement can have in shaping a teacher *s asser^sment 
methods and the assessment environment (need for accountability r specific 
issues of interest to parents^ etc*)* 



VIII* POLICE AND A^fSBSSMEHT 

This teacher has been teaching in the district for 20 years and thus knows 
the basic ground rules* However^ wtoen I asked about specific policies she was 
usually vague about them* 

Testing : She hasn't had to read for standardized testing for yearsr so 
she is not sure what the *'RITb*' (State graduation competency tests) require 
for reading now* She feels that reading kills the Southeast Asian kids — they 
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study hardr do their homeworkr get passing greuSesr but can't pass the 
KITS — and yet they'll be able to go outr get jobsr and function fine. She 
notes that making standards for all isn't really appropriate or fair. (1 did 
not get information about school standeurds regarding course-specific testing.) 

Homework policy i She supposes there is one written dovm somewhere and 
remembers that the teachers had to come up with something once^ but she 
obviously follows her own peroepticms of the students* needs and^ more 
important in the day-to-day classroom operations^ their willingness to do 
homework. 

Attendance : She reports attendance daily^ keeping track of absences and 
teurdiness. These are major problems in this school and the attendance officer 
is kept busy. (He escorted several students to class during the week 1 
observed.) This teacher seems to have considerable discretion in this area; 
she is willing to find ways to help students complete a course even when they 
have been absent much of the time. 

Content of the curriculum i As noted, she believes in continuity and did 
confer with the department when she planned her courses last year. She noted 
that the English curriculum at this high school is a jumble this year because 
they are in the process of changing to fit the district curriculum (at least 
regarding levels) • ^r example^ the dXcfrict specifies that American 
Literature be taught on the junior level; at this school it has been a 
sophomore*level course. Next*year t^iey will conform to district 
specifications. She would mlcome some comparaibility with district standards 
to ease the problems of students who transfer. 
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PROFILE OF LANGUAGE ARTS CASE |1 



I. ASSESSMENT PURPOSES 



A. Diagnosing individual 
student needs 



B. Diagnosing group needs 



C. Assigning grajes 



D. Grouping for instruction 
within clasc 



E. Identifying students for 
special services 



F. Controlling and 
motivating students 



G. Evaluating instruction 



H. Connunicating achievement 
expectations 



I. Conmunicating affective 
expectations 



J. Providing test-taking 
experience 



uninformed X_ Well informed 

Irrelevant X_ Relevant 

Useless jc_ Useful 

Not used x_ frequently 

Uninformed JL Well informed 

Irrelevant JL televant 

Useless JC_ Useful 

Not used JC^ ysed frequently 

Uninformed X Well informed 

Irrelevant J^levant 

Useless Jt Useful 

Not used X Used frequently 

Uninformed Well informed 

Irrelevant Jt Relevant 

L*&eless X Useful 

Not used X Ufied frequently 

Uninformed X Well informed 

Irrelevant X_ itelevant 

Useless _X Useful 

Not used X Used frequently 

Uhinformed X_ Well informed 

Irrelevant X_ Relevant 

Useless X Useful 

Not used X Used frequently 

Uninformed X_ well informed 

Ir re levan t X_ Re levan t 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed X_ Well informed 

Irrelevant X_ televant 

Useless X_ Useful 

Not used X Used frequently 

Uninformed X^ Well informed 

tr re levan t X_ ^ levan t 

Useless X^ Useful 

Not used Used frequently 

Uninformed X^ Well informed 

Irrelevant JC Relevant 

Use Isss X Us ef u 1 

Not used X Used frequently 



ERLC 



410ee 



166 



193 



K. Belative importance 

of purposes (to the teacher) 



Given **100 importance points^ to distribute 
across the purposes llstod below^ how would 
you distribute those points to reflect the 
relative importance of the decisions listed? 



Diagnosing individual needs 
Diagnosing group needs 
Assigning grades 
Grouping for instruction 
Identifying students for 

special^ services 
Controlling and 

motivating 
Evaluating instruction 
Communicating achievement 

expectations 
Communicating affective 

expectations 
T^st taking experience 



16 



16 



10 



16 



15 



10 



100 points 
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II. ASSESSMENT METHODOIOGY 
A. Assessment of Achievement 

I- Teacher "develoned paper and 
pencil tests and quizzes 



2. Text-Embedded paper and 
pencil tests ar^ quizzes 



3* Performance assessments 



4. Oral quest ion inc) strategies 



5. Standardized testa 



6* Group assessment 
ipethods 



7. 0{>inions o£ other teachers 



8* Assessment of reasoning 
skills 



9* I^gular assignments 



10. Student peer ratings 



Uninformed X_ Well informed 

Inappropriate JL Appropriate 

Use le ss X_ Us ef u 1 

Not used X_ Used frequently 

Uninformed X_ Well informed 

Inappropriate X Appropr iate 

Useless X Useful 

Not used X U^ed frequently 

Uninformed X Well informed 

I nappr opr iate X_ ^^^^ 

Useless X_ Useful 

Not used X Used frequently 

Uninformea X_ Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed X_ Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used X Used frequently 

Uninformed X_ ^ Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used X Used frequently 

(Heard of one^ but didn't see) 

Uninformed X^CNot sure )ifell informed 

Inappropr iate X Appropr iate 

Useless X Useful 

Hot used X Iteed frequently 

tftiinformed X Well informed 

Inappr opr ia te JC_ Appr opr iate 

Useless ^ lx_ Useful 

Not used X_ Used frequently 

Uninformed X_ Well informed 

Inappropriate X_ Appropriate 

Useless JL Useful 

Not used >L Used frequently 

Uninformed J[ Not known ) Well informed 

Inappropr iate X Appropriate 

Useless X Useful 

Not used X Used frequently 



ERslC ^fis 



11* student self ratings uninformed 

Inappropriate 
Useless 
Itot used 

12* Proportion of all assessments for all purposes that are of various types 
This depends on the subject being taught* Overall for all classest 



(N ot known ) Well informed 

X Appropriate 

X Usefu 1 

X Used frequently 



Teacher-developed paper and 



pencil tests 12 
T^xt-embedded paper and 

pencil tests 8 

Perfomiance assessments 5 

Oral questions 40 

Standardized tests 2 

Opinions of other teachers 1 

Begular assignments 31 

Group assessments 0 

Student peer ratings 0 

Student self ratings 1 



100% 



13* Cognitive levels of questions posed in: 



Study and Oral Tests and 

Discussion Questions Questions Quizzes 



Recall 



See attached 

Analysis 
Comparison 
' Inference 
£valuatlon 



14* Strategies for 
assessment and 
Instruction 



integrating 



IS* Dealing with cheating 



uninformed X_ Well Informed 

Inappropriate X_ ApP"Prlate 

Useless Useful 

Not used Used frequently 

Uninformed Well Informed 

Inappcopclate 3^ Appropriate 

Useless x^ useful 

Itot used X Used frequently 
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II*A*13* Cognitive levels of questions posed in: 



Study and Discussion Questions 





Text-embedded 




Teacher-deve loped 




All 


Lit. 


ComPc 




All 


Lit. Contp. 


Recall 


39% 


16% 


73% 




23% 


23% 


Analysis 


7% 




18% 




11% 


11% 


Comparison 


4% 


6% 






8% 


e% 


Inference 


46% 


73% 






44% 


44% 


Evaluation 


4% 




9% 




14% 


14% 



*A11 teacher-developed 
(I did not tally the TSWE questions.) 
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# • 



All 


Lit. Comp. 


47% 


43% 61% 


14% 


10% 26% 


6% 


6% 4% 


24% 


31% 


10% 


10% 9% 



Tests and Quizzes 



All 


Lit. 


ComP. 


49% 


58% 


43% 


33% 


3% 


55% 


14% 


34% 




3% 


5% 


2% 
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B. Assessmgit of Affect 
1* Observing individual 
students 



2* Observing group 
interactions 



3* Using questi<»inaires 



4* Using interviews (formal 
and informal) 



5* pinions of other 
teachers 



6* Opinions of other 
students 



7* Opinions of parents 



8* past student records 



Uh in formed 



Well informed 



Inappropriate X Appropriate 



ttot used 

Uninformed 
Inappropriate 
Useless 
ttot used 

Uninformed 
Inappropriate 
Useless 
Hkyt used 

Uninformed 
Inappropriate 
Useless 
Uot used 

Uninformed 
Inappropriate 
Useless 
Uot used 

Uh informed 



X_ Useful 

X_ Used frequently 

X_ Well informed 

X_ Appropr iate 

X_ Useful 

X Used frequently 

^No t Known) Well informed 

Appropriate 

Useful 

^^^^ _ Used frequently 



Well informed 

X Appropriate 

X Useful 

X Used frequently 

Well informed 

Appropriate 

Useful 



X 

JC 

X UseA frequently 



Well informed 



Inappropriate X Appropriate 



Useless X_ 

Itot used X_ 

Uninformed 

I nappropr i a te 

Useless 

Not used X_ 

Uninformed 

I nappropr iate 

Useless X_ 

Uot used X 



Useful 

Used frequently 

JC Well informed 

JC Appropr iate 

JC Useful 

Used frequently 

Well informed 

Appropriate 

Useful 

Used frequently 
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9* Checklist of affective characteristics measuiedi 

F Seriousness of purpose Code ; 

F Motivation and effort F » formal assessment ooiiducted 

I Attitude I « informal assessment conducted 

I Learning style 
I Interests 

Values 

Pre f er ences 

, I Academic self-concept — she knows who thinks of self as good 

student or poor student 
Locus of control 
I Anxiety—especially re test-taking 
I Maturity 
I Social skills 
I Stu<3^ skills 
, Other (specify ) 
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10* Belative importance of affective assessment methodst 
(To the teacher) 

Observing individual 

students 
Observing group 

interactions 
Using questionnaires 
Using interviews 

(formal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Fast student records 



40 



30 



15 



100% 



C# iteaesgment of Ability 

1* Heaming of ability for teacher 
Value of this factor 
for the teacher 



Iropor tant X Unimportant 



Measurement of ability 



Measured forinally 
Measured informally 
Not measured 



Ingredients considered in assessment of abili^^ if measured: 



1* 



PACrOR(S) INCLUDH) IN ASSESSMENT 
Previous performance 



MEASURED HOW? 

Standardized test scores; 
quality of work and grades 



2* 

4* 

5* 



Quality of work 
Spark/ inter est 
Timeliness of w>rk 



Teacher's observation and 
experience with other 
classes, years* schools 



2* Check decisions influenced by results (i.e*, change with varying levels of 
ability)* 



Instructional objectives 
Instructional strategies 
Grouping for instruction (within class) 
Methods for measuring achievement 
Grading standards 

Students selected for special services 
Other (specify 
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D* Tfext Asseaaments 

Checkliat of assessment components provided with text-depends on the class 
See attached 



Oral questions for class use 
Homework aaaignments 

General aaaesament guidelines for teachers 
Paper and pencil tests 
Performance asseaaments 
Scoring guidelinea 
Quality control guidelines 

Other (specify ) 
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II«D« Text Assessments 

Checklist of assessment components provided with text - depends on the class* 

Literature 

Regular Advanced 

Am. Literature Other * Composition 

a> a> a> 

iH H H 

*S "3 

iH H H 

•H '0 'H '0 'H 'O 

Of a> n) a> to a> 

t> W > (0 t> w 

< D < D ri: D 



Oral questions for class use 

Homework assignments 

General assessment guidelines 

for teachers 
Paper and pencil tests 
Performance assessments 
Scoring guidelines 
Quality control guidelines 
Other 



X 
X 



Some 
Some 



Don't know 
Not sure 
Not sure 
Don't know 
Don't know 



No N/A 
No N/A 



No 
No 
No 
No 
No 
No 



N/A 
N/A 
N/A 
N/A 
N/A 
N/A 



X 
X 



X 
X 



Don*t know 
Don*t know 
Don*t know 
Don't know 
Don't know 



* Advanced American Literature and Advanced Senior English* 
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III. CRITERIA FOR SELECTING ASSESSMENT METHODS 

A. Results fit purpoSw Uninformed 3L Well informed 

Un impor tant X_ Inipor tant 

Not used IJsed rrequently 

B. Method matches material Uninformed X_ Well informed 

taugh t Un impor tant X_ Impor tan t 

Not used X Used frequently 

C. Ease of development Uninformed X_ Wfell informed 

Un impor tan t X Dnpor tan t 

Not used X Used frequently 



4^ E). Ease of scoring Uninformed X Well informed 

Unimpor tant X Inipor tan t 

Not used JL frequently 



E. Origin of assessment Uninformed X_ (tell informed 

(if good) — Unimportant _X Important 

Not used ^^^^ _^ X Used frequently 



F. Time required to Uninformed X_ Well informed 

administer Unimpor tant X Inipor tant 

Not used X Used frequently 



G. Degree of objectivity Uninformed X Wfell informed 

Unimportant x_ Important 

Not used X Used frequently 



H. Applicability to Uninformed X_ Well informed 

measuring thinking skills Unimportant X_ Important 

Not used X_ Used frequently 

I. Effective cc»itrol of Uninformed X Well informed 

cheating ttaimportant ^jt Mportant 

Not used X Used frequently 



J. Relative importance of criteria 

Results fit purpose 20 

Method matches material taught 20 

Ease of development 5 

Ease of scoring 8 

(if goody Origin of assessment 2_ 

Time required to administer 5 

Degree of objectivity 12 
Applicability to measuring 

thinking skills p 

Effective control of cheating 5 

100% 
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IV. ^hLlT£ OF ASSESSMEtrrS 

A* IPercent of PaPftr and pencil aaaesaments ( teacher*developed or text^znbedded) 
having the following characteristics (naed not total 100%): 



Clear description of assessment specifications 

Matches content of instruction 

Hatches cognitive levels of instruction 

Minimizes time required to gather needed information 

Item format matches desired outcome 

Items clearly written 

Items sample danain 

Scoring procedures planned^-almost never specified to kids; 

in her head 

Scoring criteria written for essays»told what must be includedi 

but not necessarily the score 

Clear directions 

High quality reproduction 

T^st scheduled to minimize distractions—high level of distraction 

in class! (but she tries) 




fi« Percent of performance assessments having the following characteristics: 
;i saw very few of these) 
% 

75 Clear description of trait to be measured with levels of 

proficiency articulated«in her head 
75 Matches intended outcomes of instruction 
95 Minimizes time required to gather needed information 
75 Clear performance criteria-*in her head 
33 Students aware of criteria 

33 Thoughtful exercises yield performance samples 

33 ISxercises sample performance danain 

75 Performance rat^jig planned"in her head 

95 Results match information needs 



C» Percent of oral auept;|Qng having the following characteristics: 
t 

85 Sampling methods cover range of achievement levels of students 

607 Strategies involve everyone—active get more attention 

85 Ifeacher waits for response — very good on this and on probing 

95 Student's response given supportive react ion***extremely good and 

builds on them 
60 Questions match cognitive levels of instruction* 
57 Written performance records maintained — only a check re classroom 

participation 

*May spend more time on recall then she would prefer to get class back on track or 
check where they are* 
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V. FEEDBACK PBOCEDURES 

A. For oral and nonverbal feedback 

Percent of feedback delivered to students who are: 
t 

40 Strong (vs. weak)-^and middle gets less attn. than extremes 
40 Correct (vs. Incorrect) -*iaore needed for incorrect to help get on 

track 

50 Male (vs. f^uale) 

Percent of feedback having the following characteristics! 
t 

85 Delivered in class (vs. out of class) 

. 80 Oral 'vs. nonverbal) 

75 Public (vs. private) 

95 Pair (vs. unfair) 

45 Focused on achievement (vs. affect) 

Germane (vs. irrelevant) 

95 Immediate (vs. delayed) 

40 Positive (vs. negative) 



For written feedback 

Percent of feedback delivered to students who arei 
t 

. 40 Strong (vs. weak) 
50 Correct (vs. incorrect) 
50 Male (vs. female) 



Percent of feedback having the following characteristics: 
t 

35 Comment (vs. symbol) 

80 Positive (vs. negative) 

95 Pair (vs. unfair) 

95 (Jermane (vs. irrelevant) 

. 75 Ftocused on achievonent (vs. affect) 



Uses samples of performance Never X Frequently 

as feedback 



Uses public achievement chart Mever _X Frequently 

as feedback 
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VI. DESCaiFTIOH OF TEACHER AND ASSESSMENT 

A* Teacher background 

1* Teacher eicperience^ number of years: 



20 



20 



9+1 



20 



Overall 

At gra<3e level 

In school — interrupted by 10 

years at different school 
With content 



2* Relative contributions of various sources to teacher ^s knowledge of assessment 
methodology 



10 



10 



_0? 



-21, 



100% 



Teacher preparation training 

Inservice training»including workshop at local college 
Ideas and suggestions of colleagues 
Professional literature 
Teacher ^s guide to textbooks 
Own experience in classroom 



B* Teacher's expenditure of time 

1* Proportion of time spent in teaching activities — all time^ not just class time 



% 

20 



20 



Planning 

Teaching (one on one) 



20 Teaching (group) 

30+ Assessing (see list below) — this incl. oral questioning 
10 Other (specify: counseling ) 



100% 



2* Proportion of time spent in assessment activities (paper and pencils performance 
assessments oralr assignments) 



Reviewing and selecting assessments 



20 Developing own assessments 

20 Administering-'^incl* oral questioning^ which takes up a lot of time 

30 Scoring and recording 

20 Providing feedUck 

5? Evaluating quality 



100% 



C* Teacher characteristics 



R"^le in the classroom 



Curriculum maker 
and presenter 



Servant of policy 
delivering 
required content 
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ExpectatlcHis of Expects a 

professional selt Expects little X_ great deal 

Structure needs Rigid X_ Flexible 

View of high Correctness Degrees of 

quality performance demanded X_ quality eval# 

Stereotypic view of students Hone X Expressed often 

Attends to exceptiOTal student Never JL Frequently 

Sense of performance norms Unclear 3^ Very clear 

but unstated 

OrientatiOT to experimentation No risks JL taker 

Orientation to cheating Ho concern X Major concern 

Amount of cheating tlone X? A great deal 

Value of prcmptness; importance 

of timely work completion Dhimportant X Important 

Interpersonal environment of 

the classroom regarding assessment: 

Cooperative None 2L F^^equent 

Competitive None _X Frequent 

Attributions for reasons ^ - 
student success/failure: 

75 Due to student 
25 Due to teacher 
100% 

Basis for grading studentst 
30 



Level of effort 
Sense of ability 
60 Demonstrated achievement 



10 



100% 



Interpretation of assessmentt 



90 



10 

100% 



Horm-referenced 
Criter ion-referenced 



r id 
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VII. TEACHER S PERCEPTIONS OF SlUDENT CHARACTERISTICS 

A, Ability to learn Low X High 

No variation X_ Great deal 

Variation ignored X_ Mdressed 

B. Willingness to leatn Low X High 

No variation X_ Great deal 

Variation ignored X_ Addressed 

C. Rate of achievement Low X_ ^ , High 

Decreasing X Increasing 

No variation , __ X Great deal 

Variation igncared X_ Addressed 

D, Maturity irresponsible X_ , Responsible 

No variaticm Great deal 

Variation ignored X Addressed 



Study skills 



Undeveloped 
No variation 
Variatim ignored 



I>eve loped 

X Great deal 
X Addressed 



F* Social skills 



Undeveloped 
No Vjuriaticm 
Variation ignored 



Developed 

X Great deal 
X Addressed 



G* Willingness to perform 



Petioent 
No variation 
Variation ignored 



Willing 

X Great deal 
X Addressed 



H* Feedback needs 



I* Self Kissessment skills 



Wteak X Strong 

No variation X_ Great deal 

Variation ignored X_ Addressed 

Undeveloped X^ l>eveloped 

Bo variation X_ Gteat deal 

Variation ignored X Addressed 
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J* sense of fairness 
(I*m not sure) 



Unclear ^ X Clear 



Ho variation 
Variation l9nored 



Great deal 
Mdressed 



K* Beactlon to testing 



Lt Parental expectations 



Tranquil ji^ Anxious 

No variation " X Great deal 

Variation Ignored JL Addressed 

Unclear X Cle ar 

low X High 

On impor tan t X_ Impor tan t 

Ho variation X^ Great deal 

Variation ignored X Addressed 



Vlli* ASSESSMENT POLICE 
(See atoached table) 
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VIII. Wiat^Ucies itiriti«ti^ classToom asseAbent? 



O R I G r H s 
District 



O F 



POLICY 
School 



# 

Colle9ial 



>4 



■4 
O 



w 

o 
o 

lb 



/ 



3 t? 



.p 

(9 



A. Do«fl a standard exist? 

B, Does teacher ktiov 
standard? 

Do«j it inpACt 
practice? Hov? 


A. 
B. 

See text 


A. 
B. 

C. 




A. 

c. 


A. 
B. 


A. 
B. 
C. 




A. 

text 


A. 
B. 
C. 


A. 
B. 

C. 








A. 

B. 
C. 


A. 
B. 
C. 

See text 


A. 
B. 
C, 


A. 
B. 

C. 






A. 
B. 

Ci 








A. 
B. 
C. 


a; 

B. 

c. 


A. 

B, 

c. 












A, 
B. 
C. 


See text 




A. 

c. 

See text 






A. 
B. 
C. 

See text 


A. 
B. 


A. 
B. 
C. 

See text 


A. 

B. 
C. 
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LANGUAGE ART5 CASE STVDY #2 



Background Information 

This English teacher teaches in the only 4-year high school in a 
suburban/rural district. The scbool is a very acad^ically oriented high 
school with a young^ progressive principal* The school enjoys great parent 
stJC>port. Gtades ar^ very important here* According to the teacher^ 40-50% o£ 
the students go on to 4-year colleges. The 1^300 member student body is 
predaninantly white. 

This teacher teaches four classes per dayt Freshman Language Arts (25 
students)^ required; two periods of "regular" (as opposed to "advanced") 
American Literature (27 juniors in each class) ^ a year*-lon9 class^ one 
semester of which is required; and Mass Media (25 students^ primarily senior 
boys)r an elective. There are six periods per day (plus an "early period" 
t^ich she does not teach). Teachers have two of the six periods free for 
"preparation and support." (They successfully negotiated for a support period 
so they could make better use of their time^ even if it meant slightly larger 
classes.) This teacher plays an active role in other school activities. In 
the fall she coaches volleyball (she used to coach basketball) . She is 
currently involved in the first school^ide Writing Festivals which is being 
scored by outside judges^ but which requires considerable time to coordinate* 
She and her husband (who is also a teacher at the school) were prcxn chaperones 
during the time X was observing at the school. 



I. ASSESSMENT PURPOSES 

This teacher states that she uses assessment for the following purposes: 
to check what she*s done; to see if some (certain?) kids are paying attention; 
and to see if the kids are undeiTStanding the material. She notes that in 
teaching literature^ her assessments are generally two-fold: objective (to 
assess specific knowledge of plots) and essay (to assess students* handling of 
ideas^ themes^ and concepts). For herr the point of teaching literature is to 
teach students to appreciate and understands rather than to know the details 
of a particular piece. "It*s so subjective!" she exclaims* 



A. Diagnosing individual student needs 

At the beginning o£ the years the teacher says it takes a couple of weeks 
to size up the class. In particular she notes whether students turn in their 
work on time^ are late with it or never hand it in. She also watches 
classroom behaviors such as attendance and participation in class. Throughout 
the year she uses oral questioning^ written study questions and tests and 
quizzes to monitor how students are doing. For example^ at one point when the 
class was correcting a quiz^ she cosunented^ "If you got that one wrong I*m a 
little concerned because that was an important part (of the story)*" Most of 
her assessing is geared toward group needs and evaluation of group 
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Instruction^ however* In factr she controls the pace of tne classr actively 
discouraging Individual students from reading ahead or doing outside 
activities related to the topic (such as seeing the movie version after 
reading the book)* She vants the students to stay together as a group* 
Rather than bringing In new work to challenge and stimulate individuals or 
allowing or encouraging them to use their own Initiative^ she chides them and 
urges them to stick with the groupr bored though they may be* 

She remarks that unfortunately she has little time to give individual 
attention* Nevertheless^ she does confer with individctal students a lotr 
calling them to her desk during seat work in class or asking them to come up 
for a minute before or after class* The main focus of these mini-conferences 
seems to be more behav lor *r elated than acadanic; she is usually talking to 
students about getting the mrk doner rather than the quality of their work* 
She did mention one example of working with a student about a specific 
problem* This stud^t always tries to write a lot for essay tests and he 
writes very slowlyr so he has difficulty finishing his tests* 
She has worked with him regarding strategies for taking essay testsr trying to 
show hijn that length is not as is$>ortant as concise presentation of the main 
points, explaining that in college he won*t be able to write as much* 

fi* Diagnosing group needs 

This is one of her major purposes in using various types of assessment* 
Through oral questioning she checks to see if the students have done the 
assignment and if they've understood itr going over in class the reading or 
study questions she assigned the previous day* She orally checks the results 
of a quizr asking ^HOw nany got 3 or less wrong?" ^HOw many did better 
because they used their books?^ ^How many didn*t use their books?^ She then 
determines whether or not she*ll allow them to use books the next time* She 
looks over their written study questions and may spend more time on one aspect 
if the group results are not what she expected* For example r most of the 
Freshman Language Arts class did not do a good job identifying characters who 
had been good or bad influences on the main character in Great EX&ectations 
and describing the values they held* This caused her to modify her teaching 
plans (see 6* below)* At another point she could tell (by the lack of 
participation in class discussion) that many of the students weren't keeping 
up with the reading* so she decided to dedicate some class time to letting 
them get caught up (something which she doesn't often do)* 

C* Assigning grades 

Assigning grades is not the major purpose of this teacher's assessment 
activities^ although she dutifully does it and it occupies a considerable 
amount of her time (see VI* Description of teacher and assessments fi* 
Teacher's expenditure of tine)* She exclaims that she has a real problem with 
grades — they measure nothing, except how hard you work* Grades label kidsr 
put them in categories that don*t always fit* She feels it's sad i£ a kid 
tries his hardest and still gets a C and thus is labeled a C student* She 
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says she talks to her classes at the beginning of the year and tells them 
she*d be h^y if they all got A*s. When asked the purpose of grades, she 
throws up her hands and says "I don't know!" She then goes on to say they^re 
a way to get you into college or law school. She notes that grades are very 
important at this school. Good grades bring status* The school^s honor 
sociel? is really big. 

She notes that as a student teacher she learntd about three grading 
systems: a numeric scale (1^2,3^4), pass/no passr and points. She prefers a 
point system so that students aren't focusing on their grade all the time. If 
they want to know what letter grade they have, they have to ask. She also 
thinks the point system is easier to manage and get computerized. She assigns 
points to a task based on the nature of the task. For example, in-class work 
usually receives no more than 20*30 points unless it*s a worksheet that was 
done over the course of a week, in which case it*s iiorth SO points. Tests are 
usually worth at least 100 points^ In general, in her two American Literature 
classes, hanework is worth about 30% and tests 60*70%. 

Overall, the work of the third quarter represents about 40% of the final 
semester grader the fourth quarter another 40%, and the sanester test 20%. 
Final grades are bastd on a percent of the total number of points possible, 
not on a curve* 90-100 ■ A, 80*89 ■ B, 70-79 ■ C, 60-69 ■ D, Below 60 - F. 
She does not flunk many students. Last quarter only two students out of all 
her classes flunktd, and that was mainly because of attendance problems. (See 
VIII. Policy and Assessment section for the school^s attendance policy.) She 
does allow for seme extra :7reait work, but rarely. She also uses pluses or 
minuses in assigning final grades. If a student is on the border^ £he 
considers attitude and participation to tip the balance. Bowever, how she 
assesses these factors is not clear. She has no written records regarding 
class, participation^ for example. 

What does she look for in students* work when she assigns points? 
understanding of the subject matter and whether they followed directions. She 
says on re^lar assignments she usually assigns a global score if they did the 
ifork and gives half the points if the work is incomplete. She notes there 
isn't much variation in points because the main purpose of the assignment is 
to use it for disoission. I did see some variation in scores on study 
question papers handad back in American Literature: Out of a total o£ 30 
points, 15 was the loi;5St for incomplete; then scores varied in increments of 
5 points from 20 to 25 to 30. (Unfortunately, I did not have the opportunity 
to analyze the contents of the papers to understand the differences in scores.) 



D. Grouping for instruction 
I did not see this^ 



E. Identifying students for special services 

She notes that in her Freshman Language Arts class, a couple of students 
were having trouble with writing and listening. She looked up their scores on 
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the grade school screening test to check her perceptions (hut did not 
reconmend thesn for special services)* She also note& that she used writing 
samples in her writing class last year to determine students' needs for change 
in placement; scoie moved from regular to advanced classes* 

F* Cbntrollinq and motivating students 

In generalr the students in these classes are much more controlled and 
well-behaved than in the classes X observed in Language Arts Case 1* Even so^ 
the lack of concentration and the amount of disrespectful behavior was 
surprising to me* Students muld talk back or mimic the teacher from time to 
timer though this was not an everyday occurrence and the climate in the 
classroom when this happened indicated that most of the class members were 
aware that this was unacceptable behavior which was likely to cause a 
reprimand* X was also surprised at the occasional need to remind students to 
bring a pen or pencil to class~this is high schoolr junior levels and after a 
year of classes* (This ms also a problem from time to time in the Language 
Arts Case 1 classes*) 

Although this teacher has been teaching for five yearsr she looksr and 
sometimes acts^ very young* She seems quite strict at firstr conmanding her 
students* attention (^All right nowr listen up!** in a loudr authoritative 
voice)* Xt is apparent that she has been compelled to do this to maintain the 
distemce between herself and her students^ particularly the boys^ who 
regularly test her* Eovever^ sometimes in what may be atteiipts to be a friend 
or comrade to her students she gets off track and initiates 
<^nversation that distracts students from their work and breaks down those 
authority barriers she has constructed* 

During most of the class time X observed she effectively controlled her 
students f using various forms of assessment both to control and to motivate 
them* She uses oral questioning to keep students on task during class 
discussions as well as to let them know that they need to be keeping up with 
the work* She uses the threat of a quiz to get them to settle down and studyr 
and she warns them that if they don*t keep up on their reading they*ll really 
have a difficult time because they*ll be having quizzes as they go along* She 
did a very nice job of using discussion questions before they had begun to 
read The Great Gats by to stimulate their interest in what they were about tc 
begin* 

She also uses points as a motivator^ even though she doesn*t like to 
en^hasize grades* Ebr example r when only 12 out of 25 in the Freshman 
Language Arts class turned in their study guide questions on timer she chided 
them that it was ioiportatit both for the points and because they would be 
required to know seme of those things later* Xn mini -conferences she 
conducted with each student at mid-term^ the subject of the amount of points a 
missing piece of work was worth came up frequently* On one occasion when she 
had cornered a student to talk t^out doing better r he asked her *%tt)at will 30 
points do for me?** Xn her Mass Media class (which is the least well-behaved 
and most difficult to motivate to do the work) she noted that an assignment on 
making advertisements was worth somewhere between 50 and 100 pointsr **so do a 
good job On it!** (Xn that same classr sh$ threatened to give F*s if a group 
of boys actually denonstrated the use of Copenhagen snuff as part of their ad*) 
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G* Evaluating inatruction 



ThiB is a major purpose of her assessments* She uses oral questioning 
effectively to determine the need to go into something in greater depth or to 
change her approach to teaching it* For example^ when she found that most 
students had answered a question improperly (see B* above) ^ she not only 
diacussca this fact in class^ but changed her teaching method from class 
discussion and individual work to small group discussion and group work on the 
question* She also uses quizes to check the results of daily class 
discussions and assignuents* She notes that quizzes are not so ifl^rtant in 
terms of their weight in assigning final grades; rather^ they are part of 
daily activities* Thus^ for her^ their main purpose seems to be to keep the 
kids on track and help her evaluate instruction* Tests^ on the other hand^ 
are the real key to seeing if the students are understanding* (She says she 
tests every 2-*3 weeks*) 

She maintains a planned pace^ even skipping some sections while reading 
aloud in class so that they could cover the material she had planned for that 
day* In this senses she is >K>t as flexible as the Language Arts Case 1 
teacher and/or does not need to adjust her pace as often* This may be due to 
the level of students here^ or to the level of her instruction and her 
expectations and the depth of her personal evaluation of the way the 
instruction is going~probably a combination of these factors* 



H* Communicating achievwent expectations 

She definitely conmunicates her aChiev^ent expectations through various 
forms of assessmeutf often subtly^ but also very overtly* She may 
specifically state that stud^ questions will be useful to them later because 
tbey^l be tested over saoe of the same issues* She also admonishes them to 
keep their quizzes because they will help them to iftudy for the final exam* 
Particularly with regard to essay tests ^ she feels it is important to prepare 
the kids* SheUl give them 10 questions and tell than that she^ll ask 5 of 
them on the test* She does this because she feels tihey need to be 
prepared~soate thought needs to go into essay topics* On one occasi<^ when no 
one knew the ansifers to her oral questions she threatened (half^joklng^ 
half-«erious) that they might have to have a quiz (thus coooRunicating that she 
esqwcted more of them) * 

She also communicates her expectations regarding achievement via written . 
comments on papers she bands back* These are usually merely one or two words 
(**Good** **£xcellent** **Good insights** **Qood response**) ^ but she occasionally 
says moret ^'Scme good insights— 'you seem to have a good understanding of 
Fitzgerald** or **A little more detailed^ otherwise a good basis** or **A little 
sketchy^ (name)^ did you fall asleep doing this?** 



I* Communicating affective expectations 

She uses oral questioning^ quittes or the threat of quizzes^ and the 
threat of assignment of lower grades to let students know when they aren't 
behaving properly* The most comon application of as&essment to this purpose 
is during class discussions when students aren^t paying attention* The 
exainples have been noted above (especially in F*)* 
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J. Prcjvidinq test-taking experience 

This was not observed and rot mentioned in interviews* The only possible 
hint of this purpose came up in her discussion of the student who writes long 
essays and needs to learn that length isn^t everything ( see A* above) • 

K. (see form) 

II* ASSESSMENT HETHOOOLOGY 
A, Assessment of achieveroent 

1* Teacher -developed paper and pencil tests and quizzes 

For her American Literature and Mass Media classes* this teacher writes 
her own quizzes and tests. She notes that teachers also share tests and 
materials a lot and some of the worksheets and quizzes in American Literature 
are shared. She places heavy anphasis on tests and believes the tests she 
gives are hard-*the kids tell her they are. However, che says she doesn't 
compare notes with other teachers. She thinks she*s a fair teacher, *'fun but 
firm,** and has heard that frcsbmen think they have "lucked out** if they get 
her as a teacher. 

(See above regarding the weight of her tests and frequency of testing. 
See section II. A. 13. below regarding the cognitive levels of questions in her 
tests.) 

2. T^xt-embedded paper and pencil tests and quizzes 

During my observation time* she was using text-embedded quizzes and tests 
in her Freshman Language Arts classr which was studying Great Expectations . 
Her reason was that she thought that these materials were really pretty good. 
(See II.A.13. below regarding cognitive level of text^mbedded test and quiz 
questions.) 

3. Performance assessments 

I did not see any performance assessments. According to her gradebookr 
last quarter and this quarter in Freshman Language Arts they had to do 
speeches^ which were worth 50 and 100 points. However^ we did not discuss how 
she evaluated them. In the American Literature classes there were no big 
papers to be written. One or two essays (as part of a major test?) were noted 
in her gradebookr but they were of minor importance in terms of points. She 
noted that if they were writing a papers they would do lots of pre-writing 
activities* so that the essay would be so set up for them by the time they 
wrote it they would simply have to follow the format. 
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The one real performance assessment was the school-wide Writing Festival 
going on while I was there* Unfortunately* I did not get to see the results* 
In all of her classes (including Mass Media) and in other classes as well* 
students were "encouraged" to participate and even given class time in which 
to write something. The pieces were being judged by outside experts* In her 
gradebook the only mark regarding participation in the Writing Festival is a 
check* 

In her Mass Media class they began another performance assessment while I 
was there^ but I did not get to see the actual performance* The students were 
working in small groups to develop an advertisement, either written or 
enacted* As noted earlier ^ she was going to assign between SO and 100 points 
to this activity, but I did not have the opportunity to discuss with her what 
criteria she would use in evaluating this group activity* (This relates to 6< 
below also*) 

4* Oral questioning strategies 

Oral questioning is a big part o£ her teaching style* both in ber language 
arts/literature classes and in the Mass Media class* She seems to be pretty 
skillful with this assessment method, keeping the cU$s moving at a quick 
pace^ trying to keep students alert and participating* She notes the need for 
making a conscious effort to call on a lot of different kids so the same ones 
{"very bright") don*t talk all the time* She also allows a lot of spontaneous 
responses* Although the pace is fast^ she does wait for a response and at 
times even lets a good discussion get going among the students to whet their 
interest before she jumps in to channel it* 

As 13* below showSf her oral questions represent a variety of cognitive 
levels* She asks a lot about plot (recall) to check their reading and a lot 
of interpretive (inference) questions* She also calls for scene evaluation^ 
but does relatively little with analytical or comparative oral questions. She 
does not keep written records of these oral assessments* however* 

5* Standardized tests 

Begarding the competencies for high school graduation^ she commented that 
they are a useless waste of time* Some students don*t pass them till they are 
juniors or seniors; the tests just hang over them as they take them over and 
over again* The only other use of standardized testing mentioned was when she 
noted having looked up the grade school screening test scores of a few 
students (see above)* 

6* Group assessment methods 

As mentioned in 3* abcve^ I observed the beginning of a group assessment* 
but did not stay long enough to see it carried out and did not get a clear 
idea frcm her about how she would evaluate it* She herself had not decided 
how many total points to give the activity* 
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7* Opinions of other teachers 



I do not know the extent of her knowle<3ge of the opinions of other 
teachers* 'Je did not discuss this and I did not see evidence of it in her 
vorkr except when she reported back to the classes about ifhat the substitute 
said when she attended the HCT£ conference* However r she is a ^^reguXarr" and 
a popular oner in the English teac rs* lounger and eats lunch in the 
lunchroom with other teachers* She is very sociable and does talk shop and 
personalities* 

6* Assessment of reasoning skillfr 

Since oui interview time turned out to be more limited than my time with 
the teacher in Language Arts Case If I didn't have the opportunity to explore 
this in depth with her* Both teachers I observed mnted to pass on to their 
students an appreciation and understanding of good literature* However r 
unlike the other teacher whose purpose in teaching explicitly included 
teaching the kids to think and pull things together r this teacher's stated 
purpose did not go much beyond "appreciation and understanding*" Teaching 
them to think nay be an implicit^ unstated goal of hersr however* Begarding 
hooeworkr for example^ she says that she looks at it to see if they're really 
thinking about what they wrote and not just jotting down a quick answer* I 
did not find out if she consciously uses any kind of taxoncmy in developing 
her assessment questions* As 13* below indicates^ her oral questions^ the 
study questions she devised and the text^mbedded study questions 3he used 
went beyond simple recall to tax higher level cognitive skills* 
Unfortunately^ she did not test for those higher level skills; both the 
text-embedded quizzes and testa and those of her own devising focused 
primarily on recall* 

9* Hegular assignments 

study and discussion questions are a way of life in all of her classes^ 
and she writes most of the questions she uses* She employs study questions 
not only as a way of assessing whether or not her students are doing tHe work 
and understanding r but also as a study guide tool for them* She reminds them 
to hang cito the question sheets^ bring them to classr and use them to study 
for tests* 

Generally^ students are expected to work on these assignments in class* 
She views homework as merely an avenue for finishing wi^t they are doing in 
classr rather than a separate entity-^a managment tool more than a grading 
device, a way to keep the kids on track and not let them get behind* Hhen she 
does assign "homework" it is usually just reading* she does not give homework 
more than 2-3 nights per week and tries not to assign anything for the 
weekend* With regard to her Mass Media classr she notes that the subject 
matter is not conducive to homework and the kids in that class won't do any 
anyway, bo it is self-defeating to assign it* When her students do written 
hcneworkr she looks for indications that they are writing about what wds 
discussed in class and that they're really thinking about it, not just 
answering quickly* In terms of her grading system^ in American Literature^ 
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for exaniple^ homevork (or class written work) represents less than a third of 
the 9rade^ vhereas tests and quizzes account for tm*tliirds. Interestingly 
enough^ homver^ vhen I asked her vho was the better of two students selected 
at random from each of her classes^ one of the factors she described in 
explaining her choices vas whether or not they did their homework and it they 
took time with it* (See 13« below for the cognitive level o£ her study 
questions*} 

She sonetlnes imposes a time lii'iit on a regular assignment to get the 
students to settle down and concentrate* For exanple^ in Hass Media she* 11 
threaten **Iiet*s go***! have to have those papers by the end of the period** 
She has a basic policy on timeliness regarding regular assignments* If a task 
is due on a certain day^ it can be turned in up until 3:00 p^m* of that day 
without loss of credit* If it is turned in later^ the student will only 
receive half credit for it* The exception to this policy is that if they are 
planning to discuss scmething in class and a student hasn*t finished the 
assignment^ he or she caimot curn it in after the discussion because it isn*t 
fair to the students who*ve done the work in advance* She Bays she explains 
her rules at the beginning of the year^ so the students know her expectations* 

10* Student peer ratings 

She has students correct each others* papers in class^ but this does not 
amount to peer*rating because no judgment is required* I don*t believe she 
uses this method of assessment formally* Regarding informal use^ I did 
observe her talking with one student about how others had done on a test* The 
student had come in to ask about his own score and then asked who 90t the 
highest grades venturing a guess as to who he thought it would be* She told 
him aome of the highest grades and he responded with surprise or disgust* 
When he was surprised she asked if that student had studied for it* However ^ 
on another occasion^ a student was **snooping* in the gradebook^ looking at 
other students* grades and she was upset with him and rmarked to ine later 
that she hated it when he did that* 

11* Student self ratings 

I did not observe this* 

12* (See form) 

13* Cognitive levels of questions posed 

(See attached sheet*) According to this analysis of the questions used 
during my observations ^ it appears that she uses mainly recall and inference 
questions with her freshmen^ and a little more variety of cognitive level 
questions with juniors and seniors* Curiously enough^ the Freshman Language 
Arts text'-embedded study questions contain the best balance of cognitive 
levels of any'-ihing she uses* 

Of greatest interest in this analysis is the contrast between the levels 
of questions in tests and quizzes (both text^embedded and teacher-developed) 
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and the levels in the study questions and oral questions* With the exception 
of the Mass Media tests which she developed, the tests and quizzes she used 
were almost entirely testing recalls even though she varied her inquiries much 
Btore in the other means of questioning* Since tests and quizzes have greater 
weight in terms of points toward a grader students are getting greater rewards 
for use of lower level thinking skills then for use of higher order skills* 
(X believe she i& unaware of this discrepancy*) 

14* Strategies for integrating assessment and instruction 

Assessment and instruction are integrated in her classroom primarily 
through her daily use of oral questioning and by working with the students in 
class to correct quizzes and orally discuss the results with than* She also 
spends much of her class time discussing the study questions they have been 
working on* I saw no evidence of Peer editing* 

15* Dealing with cheating 

When students are taking a quizr she routinely reminds th^ to cover their 
papers or turn th^ over when they're finished to protect themselves from 
wandering eyes* When I asked about test security^ she replied that she has 
not changed the questions on her tests since she arrived at this school three 
years ago* She notes that quizzes don't count that much, and she never lets 
students keep the tests* 



B* Aflgessmant of affect 

1* Observing individual students 

Much of what this teacher has to say about individual students has to do 
with affectr rather than achievement* As noted in i*A* abover when she is 
getting to know them at the beginning of the yearr the factors which help Uer 
size thm up are behavioral~turning in papers r attending classr participating 
in discussions* (Of courser these are directly related to achievement as 
well*) She notes that a lot of what goes into a grade has to do with 
personality**" and you can't assess that!" The inherent contradiction beteween 
the effect of personality on a grade and the impossibility of assessing 
personality is not apparent to her* She feels that teaching English and 
grading are extremely subjective r not like inath where things are either right 
or wrong* The amount that affective factors enter into her assessment of 
ndividuals is clearly evident in her comparison of two students selected at 
random frcn each class* when pushed to decide wh3 was the better student of 
the twor the reasons she listed for her choice included comments liket gets 
the work done, tries hardr has a good attitude^ is diligent^ participates well 
in classr has good attendance, has shown significant improvements has better 
test results* Only the last few of these are concrete indicators of 
achievement; the rest measure affect* 
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Some of these affective indicators can be easily documented — getting the 
york done and having good attendance^ for example^ ar& things on which she 
keeps written records* However^ X saw no evidence in her gradebook of how she 
records attitude^ level of effort (trying hard) r or even class participation* 
Whether or not she satnples j>ehavior representatively is unclear* She has 
certain students in each class who are obviously more disruptive than others* 
Those students necessarily get more of her attention in class (though it's a 
negative kind of attention}* As her remark about "personality" indicates^ she 
seems to believe that affect is a fact of life in teaching and assessing 
literature classes (and Mass Mediae too) and she does not seem to be too 
concerned about the difficulties or complications that entails* She has had 
no conplaints about grades this yearr ard only one last year* 

2* Observing group interactions 

As she conducts her classes^ she is continuously observing and controlling 
interactions among her students* Her classes require a considerable amount of 
group discussion* As noted above.- she scmetimes encourages or allows a rather 
free-wheeling group discussion (on the topic she has introduced) and sits back 
and enjoys the interaction as long as it*s on task and civil* 

She also occasionally asks a class to break into small groups to work on 
something* She then wanders around the room monitoring the interactions (but 
not taking !x>tes)4 tn Mass Media, when she had her senior boys work together 
to cut out pictures of advertisements^ the op^rwunities for assessing 
affective traits ^re multiple* The teacher and X thought we were back in 
grade school* On another occasion^ a fist fight broke out in the Mass Hedia 
class while X was observing* She and other students stopped it immediately 
and she later discussed it with the class (when the two participants were not 
present) and also talked with one of the boys involved privately to find out 
what was going onr noting that she was sorry to see that happen because he had 
been doing better (by what measures X'm not sure)* Xt was the first time 
she'd ever had a fight in class* 

By this time of the y«ar she has clear ideas regarding students' attitudes 
and behavior patterns, mantf of which have been formed by observing students in 
classroom interaction* However, she keeps no written record of the affective 
factors that go iiito these perceptions^ other than attendance and timeliness 
of work ccmpletion* 

3* Using questionnaires 

X saw none* 

4* Using interviews (formal and informal) 

As noted abovet she conducts informal talks with students almost daily* 
These u.?ually take place during classr while the group is reading or working 
on an a;isignment at their seats* The students targeted for these talks are 
usually (if not elways) students who are not performing up to her 
expectntions* She* 11 check to see what happened to an assignment or inquire 
about an unesiplained absence or simply talk about an attitude problem or some 
disriqptive behavior^ 
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As noted also^ she holds more formal talks with students at mld-tem. 
niese Interviews are conducted quietly at the back of the room during class. 

^ The content of these Is more achievement oriented^ but she still must deal 

with a nunber of affective factors. She announced these mid-term talks in 
Freshman Language Arts the day she planned to conduct then. One girl reacted 
with panics and the teacher calmly rminded them about how she does thls^ 
saying **! don*t have a specific total but I can give you an idea (of how 
you*re doing) and tell you what assignments you have missing.** Basically 

9 these were little peP talks in this class^ with a few reprimands about needing 

to be more disciplined in doing the work. She did not plan to spend as much 
time on mid-term consultations with her American Literature classes^ and^ in 
factf I did not observe any other formally announced mid-term talks. In hass 
Media she did seme Informal consultations with some of the students who were 
behind on assignments. She remained at her desk (on the opposite side from 

0 me) so I did not listen to these talks. However^ one boy came back from her 

desk loudly protesting^ *'If I don*t graJluate^ if I get screwed up^ I*m gonna 
be ...(upset)!** 

5. Opinions of other teachers 
0 See II.A.7. above. 

6. Opinions of other students 

I have little evidence of this^ except that she tends to chat with 
students and may ask^ "What was wrong with yesterday?** for example. 

7. Opinions of parents 

^ I did not get a very clear sense of what this teacher really knows about 
individual students* situations outside of class. She did not talk much about 
students* family situations or speculate about non*school related reasons for 
0 their behavior, she commented on the **great parent involvement** at this 

school but I saw no specific evidence of her contact with parents. At 
mid-term she sends out progress reports to the parents of kids who are getting 
D*s OK F*Sf and if tlme^ to families of kids who are doing better. If there 
are ser j ais attendance problems^ she calls the parent. 

0 8- Past student records 

I found no evidence of her use of these in assessing affect nor any 
cements about having had some students before and thus knowing what to expect 
of them. 

9. and 10. (see form) 

C. Assessment of ability 

This teacher rarely talked about the ability of her students in any overt 
i t^y- It seems that she asstmies that they are all capable of doing the work if 
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they will just apply themselves to it* Even when comparing two students 
selected at randan^ she did not talk about their differences in terms of their 
abilities or potential* There was a hint of the concept of ability when she 
mentioned that one girl was better than another student because even though 
sbe didn*t always turn her work in^ she has a real desire to learn and to do 
\^at she can do (whereas the other was very complacent and would rather fall 
asleep)* I asked how she forms her expectations regarding the potential of 
her students* They are based on whether or not the students turn in their 
workr attend class and participate in discussions* 

As noted earlier r she did at one point refer to the screening test to 
check on some freshman students and she used writing saJi^les to determine 
appropriate placement* However r she did not talk about these instances in 
terms of ability* 



D, Text assessments 
(See form) 



III* CRITERIA FOR SELSCTIHG ASSESSMENT METHODS 

A* r B, and E* Results fit Purpose* method matches material taught^ and origin 
of assessment 

She seans to feel fairly confident that the assessment methods she uses 
match the material she is teaching and fit her assessment purpose* However^ 
she might be rather surprised to see how much her tests and the text-embedded 
tests focus on simple recall* In the tests I sawr she used a lot of 
true/false and multiple -choice questions* These measure whether or not 
students have done the reading and can recall what theyWe readr but these 
kinds of questions are not so useful to measure ^appreciation and 
understanding "~her stated goals* 

Her assessment methods in the Mass Media class are somewhat more 
analytical^ but whether or not she feels the subject matter differs fran 
literature in this regard is not clear* She did say that the subject of Mass 
Media did not lend itself well to homework (which I do not understand) * 

She writes most of the assessments she uses* However, in Freshman 
Xangua9e Arts she uses tests supplied by the text, but only a very few of the 
study/discussion qiiestions in the text* This is unfortutiate^ because the 
latter appear to be extremely well balanced in terms of cognitive levels 
taxedr whereas the tests are nearly all recall* She does not happen to use a 
taxonomy of cognitive skill levels in her selection of assessments* 

D* and E* Ease of development and ease of scoring 

This teacher maintains a rather fastr efficient pace* She has a quick 
mind and doesn^t seem to search too deeply for answers to interview questions 
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about teaching and assessment* I muia expect ease of development to be 
Important to her* However r the large number o£ true/false questions she has 
to write to make up a test are not really easier to do than a lesser number o£ 
more heavily weighted essay questions. Base o£ scoring Is definitely a 
consideration for her. She uses scantron answer sheets as much as 
posslble~whlch of course is related to her use of true/false and 
multlple*cholce questions. She also uses short answer essay questions. As 
notedr on study question written assignments she does not distinguish many 
levels of polntsr but evaluates the assignment rather globally (hollstlcally?) * 



F, Time required to administer 

Her quizzes are short. The tests that she wrote to be tak«n while the 
students had a substitute were rather longr (perhaps to be sure they kept 
busy?) and In fact some students complained about the length. She seens to 
have a talrly well-defined sense of how long things should take and follows a 
pre-planned schedule relatively closely, 

G, Degree of objectivity 

She roharked several times about the subjectivity of teaching and grading 
literature classes, This may be a reason for her use of objective^ true/false 
and multiple -choice questions. However r she seems to feel confident that her 
grades are tait (recall her report that she'd only had one complaint last 
year) , 



H, Applicability to measuring thinking skills 

As Indicated In section II,A,13, abover she does employ questions that tap 
different cognitive levels. However, as her selection of test Items 
Indicates, this Is not a major criterion In her choice of assessments, 

I, Effective control of cheating 

HiiB Is definitely not of major lipportance In her selection of assessment 
methodsr at evidenced by the fact that she has not changed her tests £or the 
past three years, 

J, (See fcrm) 



IV, QUALIOy OF ASSBSSHEHTS 
(See form) 
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V* FEEOfiACK PROCEDtmSS 
(See form) 

Here^ as in Language Arts Case Ir it is important to consider the 
difference between feedback focused on achievement and that focused on affect 
in the context of oral feedback versus written* Far more written feedback 
(90%) is about achievement than is oral/nonverbal feedback (50%), due in large 
part to the nature of classroom interaction* In an active^ modern classroom 
todays the teacher must spend a lot of time controlling disruptive 
interactions* The oral/nonverbal feedback that she gives must focus more on 
affect than does her written feedback* In her classes more oral feedback is 
aimed at boys than at girls simply because the boys tend to act out more (and 
in Mass Media there cre <ar more beys)* Similarly^ her oral feedback tends to 
be a little more negative than what she writes because of the need to be 
controlling behavior in the classroom* 



VI* DESCRIPTION OF TBACHER AND ASSESSMENT 

A* teacher's background 

This teacher was trained in language arts education^ then taught two years 
at another high school before coming to her present position* When asked 
about her training in assessments she remarked there wasn*t much to tell* In 
school the assessment training consisted of learning about standardized 
testing* The main places she learned what she knows today were when she was 
student teaching and in a methods class she took 3*4 years ago at a local 
college* She notes that her present school is very good about providing 
opportunities for teachers to 9et extra training and grow* 

B* Teacher *s expenditure of time 

amount of time she spends in preparation outside of class varies 
considerably^ in part dependent upon the particular units she's teaching and 
whether or not she has taught the course before* The week before iny 
observations she spent 10-15 hours outside of class because a lot of papers 
came in at once* The week I was there she had l«ss to do* 

C* teacher characteristics 

Role in the classrocm ; This teacher is young and works in a department in 
which the curriculum is "pretty set upr" particularly the Freshman Language 
Arts curriculum (see VIII* policy and Assessments below)* She has some 
control over the timing and order of the things she teaches , and in American 
Literature^ for esample^ within an author she may choose one wor!: over 
another* She has the greatest influence on curriculum in her Mass Media 
class^there she is shaping the curriculum herself* 
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Expectations of Professional self i She thinks of herself as a 
professionals takes her job seriously^ and takes pride in her work. She has 

0 '^reasonable'* expectations of herselfr not too high and not too low. She seems 

to have balance in her life and tries not to allow her work to dcminate all 
her tine and energy. From comaents she made from time to time to students 
about herself as a student and from observing her lack of knowledge of the 
vocabulary in Vhe Great Gatsbv^ it appears that she may let herself off the 
homework hook occasionadly . She is not concerned to know everything and be 

0 fully prepared^ even when being observed by an educational researcher. 

Structure needs : She follows a fairly structured pattern with her 
classes^ yec is willing to try a different approach or activity occasionally. 

View of high quality ^performance ; Perhaps because she does not think of 
9 herself as a top students she is apathetic with her students. She does not 

donand perfection. When ^e is certain of the answer^ however^ she demands 
correctness. If she is not sure herselfr she may be a bit arbitrary (to cover 
her uncertain^} or may bend and accept several possible answers. 

Stereotypic view of studenta t This teacher seems to enjoy her students. 

0 As she remarked to them when giving them some study advice^ '*I*m not so far 

from this you know^** referring to her age and the few years she's been 
teaching. She seems to have a benevolent view of the kids^ being pretty 
satisfied that they are basically good kids who do okay. The exception to 
this view is her Mass Media class. There she has a definite view that this 
class is full of senior boys who are taking it as an ea^y class and an 

0 opportunity to goof off. She sums up her opinion of this class by saying that 

almost no one in this class will be going on to a 4*year college* 

Attends to exceptional student ; As noted, she consults with students 
regularly about their performance^ but does not feel she has t^me to give much 
individual attention. 

^ Sense of performance norms i When asked about how she sets the standards 

for her classes^ she responded '^intuiticxi'* and then went on to say that she 
has determined that students must complete a certain amount of work for a 
particular class, sbe did not elaborate on how she sets the amount, but in 
talking about her Mass Media class she noted that this year is the first time 

^ she has taught this class and that last smester she taught it differently 

than this time. The current group of students is very different (less willing 
to work) than the previous class and she has changed her expectations 
regarding the work they'll do. Last semester they did a big group project; 
this time she won't expect that of them. She seems resigned and days she has 
come to realize that she isn*t going to change their lives at this point (they 

^ are mostly seniors and this is May) • 

Orientation to experimentation ! She is willing to take some risks. 
Putting scissors in the hands of the senior boys and asking them to vork in 
small groups in front of an outside observer was taking quite a risk. She 
seems to feci confident and comfortable enough in her classes to try a little 
^ different approach once in a while. 
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Orientation to cheating ; (See III* I* above*) 

4 Jtooant of cheating ; I don't know* I was not aware of cheating during 

quizzes* There was scae collaboration going on when students were working on 
their study questions^ but I <^oubt that is considered cheating* She did not 
keep tight control on visiting during those tiroes* She does not seem to think 
cheating is much of a problan* 

# Value of prqftgfaiess; importance of tiroely work coroPletion ; As noted in 
II* A* 9* above^ she values timeliness and reduces the grade on assignments by 
half if they are turned in late* She permits make-up quizzes and tests if 
sttxlents have an excused absence* 

Interpersonal environment of the clacsroow regarding assessment ; Her 

# classroom environment is primarily ccmpetitive with regard to formal 
assessments* However^ she occasionally encourages group collaboration on a 
project* 

Attributions for reasons of atudent success/failure t As noted^ she fails 
very few students*-only 2 last quarter out of all her classes* She attributes 
0 their failure to attendance problems* She takes responsibility for trying to 

do a good job teaching* She asks often if there are any questions and will 
re-explain or find a new way to present the material so that it is clear to 
the students* 

Basis for grading students ; (See I*C* above*) She feels grades measure 

# how bard students wotkr but that is evidenced mainly by the work they 
omplete* She goes primarily by points^ allowing attitude to enter in only in 
borderline cases* This sounds very objective* However^ as she notes^ scoring 
literature essays is very subjective* Vbe question is how much the affective 
perceptions she forms over the year enter into the scores she gives on daily 
assignments and essay tests and quizzes* Since I had little opportunity to 

0 really study complete sets of papers over time^ I cannot answer this* 

Interpretation of assessment ; Final grades are based on strict 
percentages of total points possible* However^ many of the individual tasks 
that are scored are scored rather holistically* She made no mention of 
reading through to determine what the overall results were before assigning 
41 grades on essay questions; her criteria are not clear to me* On daily 

assignments getting the point and completing the task may be enough to get 
full credit (see I*C* above)* The objective parts of tests are of course 
criterion*ref erenced * 



VII* TEACHER'S PEBCEPTIONS OP STUDENT CHARACTERISTICS 

This teacher seems to expect most of her students to do well* If they'll 
do the workf the assumption seems to be that they can do it* When questioneii 
about any differences between her two American Literature classes ^ she thought 
0 they were pretty much the same^ except perhaps one group had slightly better 
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skills than the other* She Illustrated this by citing the response of the 
better group to having her read aloud* They preferred to read on their ownr 
whereas the slightly lower group wanted her to continue to read to them* 
ThiBr however^ could be the result of many factors^ not necessarily ability or 
even achlev^ent levels* 

Ttie biggest contrasts with regard to student characteristics can be seen 
In her views of her freshman class compared with the seniors In her Mass Media 
class* she aclmowledges that the freshmen need encouragement and guidance 
re9ardlng high school expectations ^ but she Is very pleased with their 
progress^ noting that 10 out of 25 are on the honor roll* At the opposite end 
are the Mass Media seniors* These contrasts relate to willingness to learnr 
rate of achlevwent^ maturity^ etc*-- -to most of the Items In this section* 

S tudy skills 1 In the American Literature classes r she Is overtly 
encouraging better stuiSty skills by training them to take notes* They have 
boxes of note cards; she may even dictate some important points for them to 
write on their note cards — which they can then use for stuiStylng and sometimes 
even for taking a test* Her Insistence of them keeping stuiSty questions and 
quizzes to Btn^ later Is another example of training for good study skills* 

Feedback needs t Thesetend to vary with the level of the stt^ents* She 
notes that the freshmen accept the limited Information she gives them at 
mld*tertt and don^t ask many questions* The juniors In American Literature^ on 
the other hand^ want to know how their points translate Into grades* She 
notes that the kids In general do not like the fact that the first and third 
quarter grades are "progress reports" and don^t count In one^s cumulative 
grade* To thra a grade Is a grade* 

Iteactlon to testtnq i In general^ her students react to testing In a 
fairly typical way-*wlth seme concern or even panic* ^he notes that she 
herself has a hard time taking tests so she thinks that might make her more 
sympathetic toward her students* With the freshmen ^ In particular r she tries 
to make them comfortable about tests and doesn't give them any surprises* 
During observations she seesaed careful in all her classes to give them 
advanced warning about the Ins^uctlon schedule for the next few days and 
especially about any planned quizzes or tests* 

Parental expectations ! As noted earlier r she considers parental 
expectations to be high at this school* Parents Plan for their kids to go on 
to college and expect the school to give thm good acad^lc preparation* 



VIII* POLICY AND ASSESSMENT 

Since this is the only high school in the districts school policies are 
the same as district policies for high school level topics and activities* 

Tiastinq t The school requires s^ester exams* She has her own rules 
regarding testing: She won^t allow make-up tests on unexcused absences* 
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Beportlna r Quarter grades ("progress reports*) and sanester grades are 
required* Hid**teriii reports are not part of school policy* She seems to have 
complete discretim regarding her grading systan* The department does not 
In^se a system or standards* Even ai&ong colleagues teaching the same class 
at the same level there is no agreonent required* In American Literature she 
uses a points system; a colleague uses a pass/fail system* 

Homework I No school or department policies* She has her own (due by 
3:00 p*m* the day specified or receives half credit)* 

Attendance t The school requires maintenance of attendance records and has 
a denser single-spaced page of rules about the attendance policy* After seven 
unexcused absences a student autcmatically loses credit for a course* The 
teacher feels this policy is problematic because students know they can have 
up to seven absences r and that even after that they can go before a board to 
explain* She feels that teachers are rather inconsistent regarding what they 
expect in attendance and many teachers feel their hands are tied to motivate 
kids* 

Curriculum content i The English department has a very structured 
curriculum for j^reshman Language Arts* There are at least 10 sections of this 
course, which is required freshman year* The course must consist of the 
following unitsi Short Story; Speech; Roaeo and Juliet ; Great Expectations ; 
The Odyssey ; and Poetry* However^ there is seme flexibility regarding the 
order in which these units are taught* Similarly^ the curriculum for American 
Literature is pretty established* It is a year-long class, but only one 
saaester is required* There are four teachers teaching this course* Thf^re 
are seven "regular* secticms and two "advanced* (a full year is required if 
students take "advanced*}* The first semester is focused on eatly American 
literature, the second on modern* The teachers meet as a group to plan their 
calendars* They must cover the same authors but have flexibility within the 
authors (in choice of storyr for example), with pace and with order of 
presentation* 
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PROFILE OF LANGUAGE ARTS CASE #2 



I, ASSESSHBMT PURPOSES 



A* Diagnosing indiviaual 
student needs 



B* Diagnosing group needs 



C* Assigning grades 



D« Grouping for instruction 
within class 



Et Identifying students for 
special services 



F* C6ntrolling and 
motivating students 



G« Evaluating instruction 



H« Conaunicating achievaKnt 
expectations 



It Coonunicating affective 
expectations 



Uninformed X Well informed 

Irrelevant , X_ Relevant 

Useless X Usef u 1 

Not used X Used frequently 

Uninformed Well informed 

Ir re levant ^ levant 

Useless X_ Useful 

Not used ^ X^ Used frequently 

Uninformed X Well informed 

Ir re levant , X_ Re levant 

Useless X Useful 

Not used X Used frequently 

Uninformed Don't know Well informed 

Ir re levant X Re levant 

Useless Don't know Useful 

Not used _X Used frequently 

Uninformed X Well informed 

Irrelevant X_ Relevant 

Useless , X Useful 

Not used X Used frequently 

Uninformed X_ well informed 

Ir relevant X_ Re levant 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed X Well informed 

Ir relevant JL ^ levant 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed 3L Well informed 

Ir re levant Re levant 

Useless X_ Useful 

Not used , X_ Used frequently 

Uninformed X Well informed 

Ir re levant X_ Re levant 

Useless X_ Useful 

Not used X Used frequently 
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J. Providing test-taking Oninforroed Don't know Well infornied 

exper i ence Ir re levan t X Be levan t 

Useless Don^t k now Useful 

Hot used _X Used frequently 



K. Relative importance Given ''lOO istportance points'* to distribute 

of purposes across the purposes listed below^ bow would 

you distribute those points to reflect the 
relative importance of the decisions listed? 

DoDportance to the teacher: 



Diagnosing individual needs 


5 


Diagnosing group needs 


20 


Assigning grades 


10 


Grouping for instruction 


0 


Identifying students for 




special services 


5 


Controlling and 




motivating 




Evaluating instruction 


20 


Ccomuni eating achieveoent 




expectations 


20 


Communicating affective 




expectations 


8 


Test taking experience 


0 



100 points 
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II* ASSESSMENT HETeODOI/DGY 



A, Agaeafiinent of Achievoftent 



1. Teacher -developed paper and tminformed X_ Well informed 

pencil tests and :uizzes Inappropriate JL impropriate 

Useless X_ Useful 

Not used X_ Used frequently 



2. Ofext-embedded paper and Uninfori:ed X Well informed 

pencil tests and quizzes Inappropriate X Appropriate 

Useless X Useful 

Not used X Used frequently 



3. performance assessments Uninformed Don't know Well informed 

Inappropriate Don't know Appropriate 

Useless Don't know Useful 

Not used X Used frequently 



4. Oral questioning strategies Uninformed X_ Well informed 

I nappr opr i ate X_ Appr ofr i ate 

Useless X^ Useful 

Not used X_ Used frequently 



5. Standardized tests Ohinformed X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not use^ _X Used frequently 



6* Group assessment 
methods 



7* Opinions of other teachers 



3* Assessment of reasoning 
skills 



Ohinformed Don't know Well informed 

inappropriate X Appropriate 



Useless 
Not used 



(During my observations) 



Useful 

Used frequently 



Uninformed 
Inappropriate 
Useless 
Not used 

Uninformed 
Inappropriate 
Useless 
Not used 



Don 't know 
Don't know 
Don't know 
Don't know 



Wiell informed 

Appropriate 

Useful 

Used frequently 



Well informed 

X_ Appropriate 

X? Useful 

X? Used frequently 



9. Regular assignments Uninformed X Well informed 

Inappropriate X_ Appropriate 

Use less X_ Useful 

Not used X_ Used frequently 
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10. student peer ratings 



Uhinfornwd 
Inappropriate 



Useless 




Don't 


know 


Hot used 


X 






Uninformed 




Don't 


know 


inappropriate 




X 




Useless 




Don't 


know 


Hot used 


X 







Don't know Well informed 

X? Appropriate 

Useful 



11* Student self ratings 



12* Proportion of all assessments for all purposes that are of various types 



Teacher-developed paper and 
pencil tests ^ quizzes 

T^xt^embedded paper and 
pencil testa & quizzes 

Performance assessments 

Oral questions 

Standardized testa 

Opinions of other teachers 

Regular assignments 

Group assessments 

Student peer ratings 

Student self ratings 



13« Cognitive levels of questions posed in: 

Study and 
Discussion Questions 



Oral 
Questions 



Recall 
Analysis 
CoQpar ison 
Inference 
Evaluation 



14* Strategies for integrating 
assessment and 
Instruction 



See attached 



20 

10 
5_ 

30 

0_ 

2? 

30 

2? 

0_ 

i? 

100% 



Testa and 
Quizzes 



Uninformed Jt^ Well informed 

Inappropriate X_ Appropriate 

Useless I 5L Useful 

Not used X_ Used frequently 



15. Dealing with cheating 



Uninformed X_ Well informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used JL Used frequently 
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IltAtlS* Cognitive levels of questions posed int 





Study and Discussion Questions 


Oral Questions 




Tests 


find 


Quizzes 






Tex t-einb<%dded 


Teac 


her-deve loped 


Text^embedded 


Teacher -deve loped 




jai 


FLA 


AL 


_MM 


All 


FLA 


AL 


JIM 


All 


FLA 


_ AL 




All 


FLA 


AL 


MM 


All 


FLA 


AL 


MM 


Recail 


17% 


17% 


0 


0 


48% 


33% 


55% 


15% 


38% 


46% 


32% 


45% 


85% 


85% 


0 


0 


83% 


0 


89% 


55% 


Analysis 


15% 


15% 


0 


0 


18% 


4% 


20% 


35% 


6% 


0 


9% 


18% 


0 


0 


0 


0 


6% 


0 


3% 


24% 


Comparison 


16% 


16% 


0 


0 


3% 




2% 


0 


3% 


0 


6% 


0 


2% 


2% 


0 


0 


4% 


0 


4% 


3% 


Inference 


28% 


28% 


0 


0 


27^1 


50% 


22i 


5% 


42% 


54% 


36% 


27% 


4% 


4% 


0 


0 


6% 


0 


5% 


14% 


Evaluation 


23% 


23% 


0 


0 


5% 


9% 


1% 


45% 


10% 


0 


18% 


9% 


9% 


9% 


0 


0 


1% 


0 


0 


3% 



FtiA = Freshman language Arts 
AL - American Literature 
MM = Mass Media 
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Assessment of Affect 

1- Observing individual Uninformed X_ Well informed 

students Inappropriate 3L Appropriate 

Useless X_ Oseful 

Not used frequently 

2, Observing group Uninformed X_ Well informed 

interactions Inappropriate X_ Appropriate 

Useless X_ Useful 

Mot used X_ Used frequently 

3, Using questionnaires Uninformed Dcm't know Well informed 

Inappropriate X Appropriate 

Useless Don 't know Useful 

Mot used _X Used frequently 

4, Using interviews (formal Uninformed X Well informed 

and informal) Inappropriate X_ Appropriate 

Useless X_ Useful 

Not used X_ Used frequently 

5, Opinions of other Uninformed Don't know Well informed 

teachers Inappropriate X_ ^ Appropriate 

VseleBB „ Don^t know Useful 

Mot used _X Used frequently 

6, Opinions of other Iftiinformed Don't know Well informed 

student*! Inappropriate X? Appropriate 

Useless Don't kn<;w Useful 

Mot used ^X Used frequently 

7, Opinions of parents Uninformed Dcm't know Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Mot used Don^t know Used frequently 

8, Past student records Iftiinformed Don't know Well informed 

Inappropriate _X Appropriate 

Useless Don't know Uiseful 

Mot used _X Used frequently 

9, Checklist of affective characteristics measured: 

F Seriousness of purpose Code t 

F Motivation and effort F « formal assessment conducted 

. 1 Attitud*^ I informal assessment conducted 

Learning style 

, I Interests 
I Values 

Preferences 
I Academic self-concept 

Locus of control 

I Anxiety 
I Maturity 

I Social skills 

, I Study skills 

Other (specify ) 

4120e OQ^ 

207 ^-^Z 



10* Belative in^ortance of affective assessment methods: 



Observing individual 

students 30 
Observing group 

interactions 38 

Using questionnaires 0 
Using interviews 

(formal and informal) 20 

Opinions of other teachers , 5 

Opinions of other students 2 

Opinions of parents 5 , 

Past student records Don't know 

100% 



C. Assessment of Ability 

1. Meaning of ability for teacher 

Value of this factw Important X_ Unimportant 

for the teacher 

Measurement of ability Heaeured formally 



Measured informally (See narrative) 

Not measured X 

Ingredients considered in assessment of ability^ if measured* 

FACTOR(S) INCLUDED IH ASSESSMENT MEASURED HOW? 

1* 
2- 
3. 
4* 
5* 

2* Check decisions influenced by results (i*e*f change with varying levels of 
ability}* 

instructional objectives 

Instructional strategies 

Grouping for instruction (within class) 

Methods for measuring achievonent 
Grading standards 

Students selected for special services 

Other (specify ) 
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D* Tfext Assessments 

Checklist of assessment ccmiponents provided with text 
(Only for Freshman Language Arts) 



0) 




Id 








Id 


TJ 
0) 




00 
D 


X 


X 


X 


X 


Don't 


know 


X 


X 


Don't 


know 


Don't 


know 


Don't 


know 



Oral questions for class use (only a few) 

Bocnework assignments (only a few) 

General assessment guidelines for teachers 

Paper and pencil tests 

Performance assessments 

Scoring guidelines 

Quality control gtiidelines 

Other (specify 



^r American Lit* I don*t know what may be available* She does nj^t use any 
text-^nbedded assesonents* 

Pbr Mass Itedia* she uses a wide variety of materials (newspapers, magazines* 
moviesf etc*} most of vnich do not have assessments as part of them* I don*t know 
what is available* Bere too she makes her own* 



Ill* CRITERIA FOR SELECTING ASSESSMENT HETBODS 

A. Results fit purpose Uninformed X Well informed 

Unimportant X_ Important 

Not used X Used frequently 

B. Method matches material Uninformed X Well informed 

taught nnimportant Important 

Hot used X_ Used frequently 

C. Ease of development Uninformed X well informed 

UnijDpor tant X Impor tant 

Not used ^X Used frequently 

D. Ease of scoring Ohinformed X_ Well Informed 

Unimpor tant X Important 

Not used X Used frequently 

E. Origin of assessment Uninformed X well informed 

imimportant _X Important 

Not used X? Used frequently 

F. Time required to Uninformed X_ Well informed 

administer Unimpor tant X Impor tant 

Not used X Used frequently 

G. Degree of objectivity Uninformed X Well informed 

Unimportant X Important 

Not used X Used frequently 

H. Applicability to Uninformed X? Well informed 

measuring thinking skills Unimportant _^ X_ Important 

Not used X Used frequently 

I. Effective control of Uninformed X well informed 

cheating Unimportant X Impor tant 

Not used X Used frequently 

J. Relative importance of criteria 

Results fit purpose 18 
Method matches material taught 18 
Ease of development 10 
Ease of scoring 12 
Origin of assessment 1 
Time required to administer 7 
Degree of objectivity 10 
Applicability to measuring 
thinking skills 16 

Effective control of cheating 8_ 

100% 
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IV. QUALITSf OF ASSESSMENTS 

A* Percent of Paper and pencil aaseaamenta (teacher-developed or text^mbedded) 
having the following character iatlcs (need npt total 100%): 

« 

„ Clear deacrlptlon of asseaament apeclf icationa 

95 Hatchea content of Instruction 

60 Matches cognitive levela of Inatructlon (More recall than In oral 
asaeasAent) 

9 0 Hlninlzes time required to gather needed Information 

7 ,5,, Item format matches dealred outcome 

9 ,0,, It«ii8 clearly written 

9 0, Items sample domain 

Don't know Scoring procedures planned — specified on scoter not on most* 

0 7 Scoring criteria written for eaaaya 

100 , Clear directions 

65 High quality reproductlon-»a few llnea mlsalng on one, acme 

punctuation and spelling errors 

90 Teat scheduled to minimize d7.5tractlons 

B« Percent of Pgrfonnance aasessmenta having the following characteristics: 
Saw none 



Clear description of trait to be measured with levels of 

proficiency articulated 
Hatches Intended outcomes of Instruction 
Minimizes time required to gather needed Information 
Clear performance criteria 
Students aware of criteria 

Thoughtful exercises yield performance samples 
Exercises sample performance domain 
Performance rating planned 
Besults match Information needs 



C» Percent of oral questions having the following characteristics: 
% 

'^S Sampling methods cover range of achievement levels of students 

60 Strategies involve everyone 

60 Teacher waits for response 

60 Student's response given supportive reaction 

75 Questions match cognitive levels of Instruction 

0 Written performance records maintained 



* Since my observations were done at the end of the yearr It may be that the 
students know by now how much a T/F or multiple choice or short answer question Is 
usually worth. 
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V* FEEDBACK PROCEIi^EES 

A* POT oral and nonverbal feedback 

Percent of feedback deXivered to students who are: 
% 

40 Strong (vs* weak) 
, Correct (vs* incorrect) 
65 Male (vs* female) 

Percent of feedback having the following characteristics: 
% 

^0 Delivered in class (vs* out of class) 

^0 Oral (vs* nonverbal) 

75 Public (vs* private) 

95 Fair (vs* unfair) 

50 Focused <»i achievement (vs* affect) (getting the work done-affect) 

^5 Germane (vs* irrelevant) 

?5 imediate (vs* delayed) 

45 Positive (vs* negative) 

B* For writtea feedback 

Percent of feedback delivered to students who are: 
% 

, Strong (vs* weak) 
50 Correct (vs* incorrect) 
50 Male (vs* female) 

Percent of feedback having the following characteristics; 
% 

70 Comment (vs* symbol) (though often brief) 

, Positive (vs* negative) 

, Fair (vs* unfair) 

90 , Germane (vs* irrelevant) 

?0 Focused on achievement (vs* affect) 

Uses samples of performance Never X Frequently 

as feedback 

Announces names of highest scorers* but these are not really samples* 

Uses public achievement chart Never _X Frequently 

as feedback 
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VI. DESOtlPTIOK OF TEACHER AND ASS£SSH£»T 
A. l^achet*6 background 

1. Teacher experience, number of years: 5 Overall 

5 ^t grade level (high school) 
3 In school 
5 With content (language 
arts/Bnglish) 

2. Relative contributions of various sources to teacher*s knowledge of assessment 
methodology 



15 



15 Teacher preparation training 
30 .,, Inservice training 

Ideas and suggestions of colleagues 
Professional literature 
Teacher's guide to textbooks — not sure 
Own experience in classroom 



40 



100% 



B. Teacher's expenditure of time 

1. Proportion of time spent in teaching activities 



15 Planning 

13 Teaching (one on one) 

40 Teaching (group) 

30 Assessing (see list below) *^inc lades oral questioning 

2 Other (specify. Counseling ) 



100% 



2. Proportion of time spent in assessment activities (paper and pencil, performance 
assessment, oral, assignments) 



20 



30 



20 



20 



Reviewing and selecting assesjtments 
Developing own assessments 
Administering~including oral questioning 
Scoring and recording 
Providing feedback 
Evaluating quality 



100% 

C. Teacher characteristics 
Role in the classroom 



Curriculum maker 

and presenter x 



Servant of policy 
delivering 
required content 
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Expectations of Expects a 

professional self Expects little X great deal 

Structure needs Rigid X Flexible 

View of high Correctness Degrees of 

quality performance demanded _X? quality eval. 

Stereotypic view of students None X? Expressed often 

Attends to exceptional student Never X Frequently 

Sense of perforaiance norms unclear X Very clear 

But not clearly stated 

Orientation to experimentation Mo risks X Risk taker 

Orientation to cheating No concern X Major concern 

Amount of cheating None _p on*t know A great deal 

Value of promptness} importance 

of timely work completion Unimportant X Important 

interpersonal environment of 

the classroom regarding assessment: 

Cooper ative None X Frequent 

Competitive None X_ Frequent 

Attributions for reasons of 
student success/failure: 

75 Due to student 
25 Due to teacher 
100% 



Basis for grading students: 



10 Level of effort 

5 Sense of ability 
85 Danonstrated achievement 



100% 



Interpretation of assessment: 



50 



50 



100% 



Horm-r e f er enced 
Criterion-referenced 



r o 
ERJC 



4120e 



244 



VII. TEACHER'S PERCEPTIONS 
A* Ability to learn 

fi* Willingness to learn 

C* Hate of achievement 



D. Haturi^ 



E* Study skills 



Social skills 



G* Willingness to perform 



H* Feedback needs 



I* Self-^assessment skills 



J* Sense of fairness 



K* Reaction to testing 



L* Parental expectations 



OF STUDENT CHARACTERISTICS 

Low X High 

No variation X Great deal 

Variation ignored X Addressed 

Low X High 

No variation X_ Great deal 

Variation ignored X_ Addressed 

Low X High 

Decreasing ^ X? Increasing 

No variation X_ Great deal 

Variation ignored X , Addressed 

Irr< 'Sponsible X_ , Responsible 

No variation a_ Great deal 

Variation ignored , X_ Addressed 

Undeveloped X^ , Developed 

No variation X Great deal 

Variation ignored X Addressed 

Ond eve loped X Deve loped 

No variation , , X Great deal 

Variation ignor X_ Addressed 

Re t icen t X Wi 11 ing 

No variation X_ Great deal 

Variation ignored X_ Addressed 

Weak X_ Strong 

No variation ^ X Great deal 

Variation ignored X_ Addressed 

Undeveloped Don't know ^ Developed 

No variation Don't know Great deal 

Variation ignored Don't know Addressed 

Unclear X_ Clear 

No variation X ^ Great deal 

Variation ignored X Addressed 

Tranquil , X Anxious 

No variation X Great deal 

Variation ignored x Addressed 

Unclear X_ Clear 

Low x_ High 

Unimpor tant X_ Impor tant 

Mo variation X Great deal 

Variation ignored X? Addressed 



VIII. ASSESSMENT POLICE 
(See attached table) 
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VIII. HhA^olIciefi Jntlue 
Fede ra 1 



cl 



State 



O R I G I h S 
District 



0 F 



POLICY 

Schooi 



DepartPhent 



Oolleglal 



9 o 



5« 

** j5 * 
/? $» 3 jp 



Does a standard exist? 

B. Do^s teacher knov 
standard? 

C. Does it inpact 
practice? UowT 


A. 
5. 
C. 


A* 
B* 


See te^t 


A, 
B, 
C, 


A. 


A. 

c. 




A. 
B. 

C, 


A. 
B* 

See text 


A, 
B, 

See text 


See text 






A. 

B* 


A* 
B. 


A. 

B* 
C. 


A* 
B. 






A. 
B* 
Cl 








A. 
B. 


A* 


A. 
B* 












A, 
B. 


See text 




A. 

3* 

See text 


- 




A. 

B. 
C 


A* 
B* 


A, 
B, 

See text 


A. 

c. 
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SOCIAL STUDIES CASE STODY #1 



Background Information 

A member of the social studies staff of a large high school in one of the 
city's more affluent neighborhoods r this teacher is responsible for three 
sophomore OtS* history classes and two senior accelerated economics courses* 
This is a magnet school for college preparation^ attracting high achieving 
students from throughout the city in addition to the middle class children of 
the surrounding environs* The observation was conducted over two weeks in May 
1966 and included interviews with the teacher and a visit to a Social Studies 
Department staff meeting* 

The school day has a modular structure^ most classes lasting 40 minutesr 
but some 20 and 60 minute periods built in for special courses* One a 
week all classes are abbreviated to permit time for student associations to 
meet* Both American history and economics are required courses^ thought of 
course^ the choice cf accelerated economics is optional and requires counselor 
approval* 

The student body is predominantly white* Girls and boys are about equal 
in number in the history classes^ but the accelerated economics is about 
two-thirds maler and the l>oys dominate discussion* 



I* ASSESSHBNT PURPOSES 

A* and B* Diagnosing individual student needs/ Diaqposinq QrouP needs 

Diagnosis of students^ individual and groupr is done primarily through a 
fall sizing up task and through review assignments that precede each test* In 
the fallr this teacher **gives a few exercises* that enable him to tell what 
skills the students are bringing to the class* Typically^ these consist a 
map-reading taskr a note^taking exerciser and a few direct questions* Besults 
are not taken too seriously r since he finds that **there is consistency from 
group to group each fall** 

Pre*test review exercises can function as a diagnostic instruments 
although that is not their primary purpose* They are due the day of the testr 
so they do not affect test content or pre-test class emphases* Their primary 
diagnostic function is as a checkr if the test results are generally badr as 
to where the students might be falling down* 

Diagnosis cannot have a major influence on this teacher's workr since the 
entire year's activity is closely blocked out in advance* Each chapter's 
homeworkr testsr make-upsr lectures^ films^ and speakers are designated in 
full detail in an individual file which the teacher has meticulously 
compiled* Sach of the three history classes and both of the economics classes 
are nearly identical in content^ pacing^ and structure of the classroosa 
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interaction* These chapter files are complete dossiers frcm which to instruct 
and assess. Since this is not the first year vith the text in American 
history and since the accelerated econonics is predcminantly text-independents 
these plans have been used before to the teacher's satisfaction. Little 
adjustment is therefore made based on ongoing diagnosis. And, as reported 
aboves the class cohorts are^ in the teacher's estimation ^ quite similar frcmt 
year to year and fron one individual class to another. 

C. Assigning grades 

All written work is graded. With the exception of two or three more 
artistic (^^oducts (e.g., a drawing of a civil war conibatant) assigned during 
the year^ history grades are derived directly frcm written assignments and 
tests* Assignments receive points and their due dates are set — all work for a 
unit Or chapter must be submitted before the test over that material, work 
not submitted on time is assessed as a zero. T^sts are point-graded and all 
points placed on a curve* then grades assigned to show the general 
distribution of about 50% C's^ 20% B*s, 15% A*s, 10% D's, and 5% F's* 

In econoaiCB^ as the term wears on^ the class shifts fron grades based 
primarily on teste and assignments to grades based .on assessment of oral/ 
written topical reports and unit tests. Four unit tests* one the final exam^ 
and the report assessments make up the grade* 

Some assessments are not taken into grading. The limited oral questioning 
that does occur is not recorded^ but is noted merely as an a£>sessment of 
on-task behavior, l^e teacher is strict abouc not taking such material into 
his grading practice ^ regarding it as part of instruction* not part of 
assessment* It does* however^ factor for him when he considers how well he is 
doing his job of communicating the material to the students^ but be does not 
alter instruction based on it. rOiere is more that he wants them to know than 
is cn the assignments and tests and the classroom observations give him an 
index of whether individuals or the group are getting just the minimum^ i.e.^ 
the material assessed in writing ^ or if they are learning more than that* 



D. Grouping for instruction within the class 

Itot done in history* In econonics^ the teacher groups strong and weak 
students together for oral report topics thus assuring that all the students 
learn^ since the stronger and more committed will teach the others* 

E. Identifying students for special services 

At this school teachers can and do make recommendations for special 
service placements^ e.g.^ in and out of accelerated classes* This tieacher has 
more than once recommended a student for removal frcm his accelerated groups* 
having ascertained that "^they are unable to follow the' structure** of the 
seminar-^like course. He judges this through an inability to keep informed 
about current events as they pertain to the class. The course requires that 
students draw inferences and he judges this by asking them to draw conclusions 
about economics fr<Hii current newspapers and news magazines. 
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F» Controlling and motivating students 

Tiests are clearly regarded by the teacher as motivational tools, assuring 
that the material is studied* iteview assignments servs the purpose of forcing 
the students to go back over the chapter or unit in preparation for the test* 
Indeedr all assigments function for this purpose r evidenced by their deadline 
date for credit of the day of the relevant test* Indeed^ the purpose of this 
teacher's work is to get the students to learn a certain body of material* In 
the accelerated econonmics classes this body of knowledge includes cettain 
analytic and organizational skills* In U*S* history it is content and a more 
limited set of skills such as interpretation of maps and political cartoons* 

control in the classroom is only indirectly achieved through assessment* 
The teacher is strict, non'interactive^ and maintains close control of 
classroom behavior by his demeanor* There is little user for example^ of oral 
questioning of the unruly to keep students on task* However^ the teacher hands 
out homework assignments at the beginning of class and students who choose not 
to be attentive are kept busy and quiet working on their assignment* It does 
not appear that they must be secretive about this, just ^uiet and not annoying 
to others* 



G» Evaluating instructicm 

Generally^ as descritted in I*A-^fi*f above^ instructicm is preplanned and 
not subject to alteration due to diagnosis of individual or group needs* 
Repetition and review are either part of the general preplan or not done* 
Since little class time is devoted to oral questioning^ each session basically 
follows a lecture outline or, in economics^ may be taken up by an assigned 
group report* 

One aspect of instructicm*~assessment practice^'^-was altered based on 
assessment outcomes* A number of history studenub who were not doing well on 
the chapter tests said that the review questions did not help themr because 
they did not comprehend an overview of the material* Since the textbook is 
topically, rather than strictly chronologically organized^ the teacher 
responded to this coaplaint by devising an alternative to the regulair review 
assignment (a series of questions covering the main points of the material)* 
The alternative is a chart that the student fills out^ telling for each events 
whenr by whom, for what reason^ etc*r it occurred* These are time-linedr so 
that the chronology of events emerges more clearly* 

H» Communicating achievemer^t expectatiDne 

Clearlyr the written assessment tasks are the measure of the teacher's 
achievement expectations* He makes it clear that the students are being held 
responsible for a certain body of material and that assuring that is the 
purpose of the assessments* Oral questioning as an achievement measure is not 
ai'ticulated to the students* 
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The meetings with small groups for economics oral reports were not held 
during the observation period/ so could not be directly observed/ but the 
teacher reports that he uses them as occasions on which to make clear just 
what the expectations are# in both content and form of the presentation. 

Students who do not speak clearly and authoritatively when presenting in 
economics may be interrupted by the teacher and asked to repeat with more 
force and assertion. The whole range of public speaking skills^ including 
quickness in response to questions/ are included in his cocanents to the 
presenters, 

I, Communicating affective expectations 

While turning back tests and assignments ^ the teacher makes affective 
coomientSf during observation only negative coisments. For exaiEple# he might 
say to a student that bis/her score (apparently a low score) reflects the 
level of attention that the student has been giving the class. The habitually 
tardy also get such negative coeonents when their papers are returned. 



J, Providing test-taking experience 
Hot seen, 

II, ASSESSMENT METHODOLOGY 
A, Assessment of achievaaent 

1, and 2, Teacher -developed paper and pencil tests and quizzes AND 
text -embedded paper and pencil tests and quizzes 

This teacher develops all his own tests and quizzes. He states that the 
tests that accoo^any the text are too "rote"/ that they measure only recall 
and that that is not his goal. Occasionally he will "borrow" one of the 
"good" questions from the text. However^ analysis of the test questions 
developed by the teacher indicate that his tests^ too^ are basically recall 
exercises, ^See II,A,13, below,) 

Testing in history takes place at the end of each chapter and each 
three*chapter unit. Since a chapter is covered in a week^ each Friday is a 
test day. Quizzes are not given. Tests are point-graded and placed on a 
curve. The curve is based on an at least 50% correct score for a passing 
(<C*) grade. Usually^ the teacher reports^ there are more *A* and *B* grades 
than and *F* grades. Test grades and assignment scores are summed by seme 
method not made clear in response to my queries to make up a final grade that 
is reported as a zero to four point scale. 

In economics^ a similar pattern of assignments and tests was followed 
early in the term^ but later the students moved to oral reporting and tests 
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are only given on unit basis — eoononics has a total of four short essay unit 
testsr including a final exam* The teacher had firmr though judgmental 
criteria for grading*-*"! have in mind what should be there'^-^and a student 
receives an *A* if it is "all thereof a *B* for ^'a small amount missed** and a 
*C* if there i& "a lot missed"* Since econonics is an accelerated classr 
there are generally no grades below a 'C** 

In econcxnicsf material presented by students on reports beccMoes the basis 
for tests on those subjects* The teacher takes content notes during 
presentations* 

3* Performance assessments 

Performance assessment makes up a significant part of the assesment in 
economics* The reports are assessed^ during presentation^ on the basis of 
content covered^ delivery quality^ and ability to answer questions from the 
class and the teacher^ in his %fordSf "content and mechanics*" The teacher 
takes notes during the presentation* Handouts^ outlines of talks and a 
written summary are sutmiitted to augment the Perfoimance assessments resulting 
in a letter grade for the activity* 

Although small groups %fork together on a single topic, each student takes 
responsibility for a subsection of the topic and is graded entirely 
independently* The quality of individual contributicm is not hard to 
identify, says the teacher; he looks at the contents the delivery^ "plus my 
own gut feelings of having iiorked with the group for a week before {the 
presentation] and observing the quality of the questions and answers*" 
Willingness to participate actively ir^ the discussion is a significant factor 
in the grade received by presenters* He finds a high correlation between 
students' ability to ^'speak off the cuff and good scores on the exams^ both 
indicating overall well-prcparedness* 

In history^ performance is not regularly solicited^ much less assessed* 
It is basically a lecture course^ with regular written assignments* 
Hap-'reading tasks and the two or three ^'art assignments" given during the year 
would constitute the only exans^les which I could observe or discover through 
interview* The "art assignments^ " of which the drawing of a civil war soldier 
or other period character is an example r were graded for "effort," "interest 
taken" and "accuracy^** although these terms were not further defined upon 
questioning* 

In the economics oral reports a variety of factors appear to become part 
of the overall assessment* Speaking styles as manifested in confidence^ 
ability to think quickly and respond immediately to questions from the floor, 
demonstrated effort (in the preparatory meetings as well as the reports 
th^selves)r etc* play a direct role and a role that the teacher 
acknowledges^ though he nould probably not regard them as affective^ but 
rather as achievement indicators* 
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4* Oral questioning strategies 

In history, little oral questioning was used, rather the teacher lectured 
on points within the material that he expanded on in great depth* Overview 
was to be gained frcn the reading and assignments* In a 40 minute classr the 
number of questions asked averaged less than two per period; sane periods none 
were put to the class* Host were in£erential*-could they draw seme conclusion 
or speculation from i^at he had just presented — and all were responded to by 
volunteers* 

In ecotiomicsr quBStloning was used to follow up on the oral reports* The 
class put questions to the reporters^ both to review material that they were 
not sure they had understood and to ask presenters to offer further 
information or opinions* The teacher also asked questions, about four per 
period* Those observed were all directed at one of the presenters* 

(See II*A*13, belowr for cognitive levels of the questions*) 

5* Standardised tests 

Not used* There will be a social studies minimum competency tests fran 
the state soon; the social studies staff at this school is not in favor* 
However r they are working to prepare questions and general scope of the test 
drafts r in order to shape it, if possible* 

6* Group assessment methods 

Although econanics oral reports are prepared by small groupsr each student 
is assessed individually* (See also XI* A* 3*r above*) 

7* Opinions of other teachers 

This teacher shares opinions about individual students freely with his 
TOlleaguesr although he does not feel that such information influences his own 
view* He does take recoamendations from colleagues into consideration when 
evaluating for placement in accelerated classes* 

8* Assessment of reasoning skills 

Although the teacher stresses that his purpose in assessment is to 
evaluate achievement andr i£ questioned^ he responds CHily with examples that 
wuld be categorised as content learning^ he is also looking for other types 
of skill development and, at least in accelerated econanicsr is assessing on 
the b^sis of then* Success in economics is in part measured by a student's 
ability to 'understand the structure of the course*' That isr the student 
must be able to organise materials draw out the most in^rtant points trom 
readings, draw conclusions and make inferences about it ^en questioned in 
class* The few questions put to the class in history were inferential 
queries, although none of the assessment activities called for this skill* 
There are ambiguous messages about the importance reasoning skills given out 
in these classes and lack of clarity about what is demanded in the 
assessments, at least in economics* 
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9* Kegular ^assignments 

Along with the mekly teacher-deveioped tests^ assignments form the core 
of assessment in history* There ore assignments ''practically every day^** all 
written for submission and point grading* A *'basic assignment** is ''reading 
text and answering questions in writing*** Before each test there is a 
*'summoaary*' task that serves as a review* These may be submitted as responses 
to questions the teacher sets or^ as described in I*G*r above ^ an outline 
chronology* Assignments are to be turned in the following day^ but will be 
credited if turned in before the test on the material they pertain to* 
Students have the right to request a rewrite^ if they turn their work in long 
enough before the test to have the rewrite oo9^1eted* 

Host assignments are questions to be answered^ although map completion is 
also frequent* These map assignnents are basically replications of maps in 
the text* Editorial cartoons are also given out with questions to be answered 
about tb€m* Much of this daily work is frm materials accompanying the text* 
Almost all of it is recall work* One o£ the students reflected on the class 
work^ noting that *'it*s always the same** and^ in fact^ that observation seems 
accurate* 

10* Student peer rating 

Hot seen* 
11* Student self ratings 

116 1 seen* 

12* Proportions of all assessments for all purposes that are the various types 

U*S* history and accelerated economics are assessed very differently^ as 
the percentage list shows* The teacher sees the sopbaaores in history as less 
mature and also less interested* He teaches them the necessary subject 
matter* The seniors in the advanced econmlcs he attempts to challenge and 
also expects them to be willing to take more responsibility for their own 
learning* 

13* Cognitive levels of questions 

This teacher acknowledges that he does not feel completely confident about 
his ability to assess^ though not with reference to the different cognitive 
levels* He would like to have professional development on this topic* **! 
feel^** he says^ *'that I*m too subjective^ even though lots of scores go into 
it*- 

14* Strategies for integrating assessment and instruction 

Seen only in the oral reports in the economics class* See II* A*, 3*^ 
above* 
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15. Dealing with cheating 

»^ake up tests are always different from the regular test. They require 
short essays^ rathet than objective answers^ so they cannot be copied from 
another student who has taken the test. During tests the teacher constantly 
iDonitots the room^ walking around and watching the students^ occasionally 
asking someone to nove further from neighbors. 

B. Assesgment of affect 

It seeas to me that we need some parallel to the first question under 
"^Assessment of Abilityf*" i.e.^ the relative ifliportance of this to the 
teacher. In this case^ I would rate affect as of quite little value to him^ 
and far higher for the other social studies teacher* 

Generally^ this teacher distances himself from any consideration of 
affective variables in his assessments. He is careful to assign points and/or 
grades to written or presentation work. He admits no other factors in his 
grading process. There is no hint of extra credit wrk or raising of grades 
for students who ask to rewrite their assignments~the second point result is 
simply substituted for the first att^t. 

1. Cttsserving individual students 

Very little attention is paid»the teacher lectures^ using the same 
lecture regardless of the attenciveness^ skills^ etc. the students. The 
single example that suggests attention to affective factors of individual 
students is the creation of the alternative rctview schema for those students 
who complained that they just couldn't get the facts straight. The teacher 
felt they had wak study skills and this matrix format would assist them. The 
alternative assignment is assessed as equally sufficient work. 

2. Observing 7roup interactions 

Seen only in the economics oral report groups. Part of the teacher's 
assessr^nt of individuals' contribution to the group and therefore their grade 
for the project is the assertive role they take in the small group's meeting 
with him* Similarly^ responses to ijuestions asked by classmates are observed 
and evaluated by the teacher. 

3. Using questionnaires 
Not seen. 

4. Using interviews (formal and informal) 

This teacher does not spend a great deal of time one**on-one vith his 
students. He readily answers questions before and after class^ but few 
students seek him out^ not does he encourage this. He thinks they should go 
to counselors with general academic or personal problems. The economics 
students must have one or more meetings with him in preparation for their 
reports; these become part of his basis for assessing the final product. 
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5* Opinions of other teachers 

This teacher listens thoughtfully to his colleagues^ but draws his own 
conclusions* 

6* Opinions of other students 

Not seen* 

7* Opinions of parents 

In this school aost parents are actively involved in their children's 
education^ are attentive to hOMWork^ push their children to achieve* This 
teacher does not seek out parents' opinions^ nor regard them as important 
input in any decision he makes* If there are problems^ he follows the school 
policy for written parent contact^ but does not see them unless they come in 
to meet with the counselor and request his presence* 

8* Past student records 

Tbe teacher does not report any reference to past student records* 

9* Affective characteristics measured 

These factors are considered in the oral report grading^ but they are 
''clear''f in his words^ from the interactions prior to the report and the 
presentation itself an<l do not^ in the teacher's point of view^ present 
difficulty for objective assessment* 

C* Assessment of ability 

1* Meaning of ability 

General cognitive skills that enable a student to conprehend the intent of 
an assignment or reading and to interpret it in order to complete it 
successfully* 

This teacher tries (and is confident he succeeds) to assess purely on the 
basis of achievement* In history^ this means learning a body of knowledge and 
becoming able to learn from non-textual materials such as maps^ historic 
pbotosf and cartoons* In accelerated economics^ he expects students to 
achieve a variety of cognitive skills (interpretation^ analysis^ ccHnparison^ 
argumentation^ organization of material) ^ as Mil as a certain body of 
information* But all these he would place under the umbrella of achievement 
and assess as such* 
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Ill* CRITERIA FOB SELECTING ASSESSMENT METHODS 

A» and B* Results fit the purpose AND method matches material taught 

Generally^ his recall questions do ascertain if the students have studied 
the material* This is the paramount issue with this teacher* Commenting cm 
the revised review assignment option he said he was glad heM designed this 
alternative^ since '*Their scores improved and thatr of courser is my goal*" 
Certainly recall questioning suits the pedagogy of lecture about factual 
matters* 

C**F* Ease of development AND ease of scoring AND origin of assessment AND 
time required to administer 

These tests are easy to writer though it takes some consideration to be 
assured that the entire domain is :*<uiipled; they are easy to gradef and they 
can be administered in a class period* since r in history^ one day a week is 
given over to testing^ this last is an important factor* Further^ time is 
given to review of the test when it is turned back; up to 20 minutes is spent 
on going over the questions and putting up the point results and the curve* 

Hake-up testa are short essay, with specific points assigned to each essay 
and the teacher can readily state just what information has to be there to get 
creditr so theser too, are easy to score* The teacher reports that he does 
correct for bad writing on assignments^ sometimes requiring rewrite^ but this 
is not done on tests nor is it factored into scoring* 

This teacher draws roost of his regular assignments from materials provided 
with the text and develops his own tests. It is important to him that the 
tests not be known to the students, so origin of the test is a factor* 

G» Degree of objectivity 

This is a most important factor with this teacher* Although he has a 
well*planned, highly quantifiable grading strategy and tests that are 
predominantly objective (multiple choicer reorder^ matching^ fill in the 
blank) r he worries that he is "too subjective*" His comments on this subjeci. 
indicate that he feels th«£ best way to correct for this is to assess of tenr 
but that may not be sufficient* 

Seme of there assessment quality concerns may reflect his evaluations of 
the econccnics reports, which are certainly more judgmental* However^ he does 
not admit that the factors which he uses to evaluate those reports are other 
than readily observable , eveluabler achievement indicators* 



H. Applicability to measuring thinking skills 

This is an important consideration for this teacher. He eschews use of 
the text^embedded tests because they are "too recall". His testsr he saysr 
sample all levels of skills. Analysis of the teacher -developed testsr however, 
indicates that ali&ost all of bis questions, like those in the text, are 
recall. Thusr this teacher is not able to correctly apply an assessment 
principle that he himself regards as critical. 



I. Effective control of cheating 

Cheating is handled through use of a different test for make-up. it is 
short essayr rather than objective questions, so papers cannot be borrowed. 
There does not seen to be any concern on the part of this teacher that 
assignment woik is shared. Indeed^ he ccnments that seme of the students who 
ask for the alternative review assignment work thm up together. The 
assignment work must be completed to g«t credit and, he feels^ students must 
comprehend it in order to do well on the tests. That is sufficient monitoring. 



IV. QUALITY OF ASSESSH&MTS 

tl have construed the percentages as proportional ratings.] 

A. Paper and pencil assessments 

Scouring criteria for essays: All the "essays'* on regular tests are short 
written answers and they are awarded S points. Hake-up tests consist of 
longer essaysr usually 4 or 5, given S points each* Grades for tests are 
derived frcm letters or the 4-polnt scales so total number of points for the 
test is irrelevant. The essays are all recall; the teacher "knows what should 
be there" and assigns points* He marks for styles spelling^ etc* on 
assignments (and sometimes requires a resubmission) r but these are not 
considered on tests. 

Hatch between content and instruction was highr in the sense that the 
teacher lectured the facts and then askefi for facts back on the tests. The 
assignments were also predcminantly factual^ especially the review assignments 
to prepare the students for the tests. There waFr however, a marked 
difference between the content of instructional lectures and Lhe material on 
assignments and tests* For classroom lecture, the teacher selected certain 
aspects to describe in detail (e.g*^ a battle line in world War I, the 
assassination at Serajevo) which did not appear on the tests. They cannot be 
interpreted as focussing on the most in^rtant issues^ simply as interesting 
incidents selected for some other reason. The students appeared to be aware 
of thisr for only those who wore interested in the topic were paying 
attention. Thus, with regard to whether the items sampled the domain^ yesr 
they did clearly do so with regard to the text mat^rialr although the lectures 
did not point to that. 
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scoring procedures were fully planned and articulated to the students* 
The plac^ent of the cuts on the curve was generally set at 50% of the points 
for a 'C r although this went up to nearly 60%, if the class scored generally 
well* 



fi* Performance asseasments 

The only performance assessments seen were the oral reports in economics 
and the written versions turned in* 

The teacher took notes openly during the presentations^ making it clear 
that he wtas evaluating* However^ the notes mre on the content of the 
presentation^ he reported* Performance factors included in the evaluation 
were not recorded simultaneous with the presentation* 

Generally, the teacher had criteria in mind, including achiev^entr 
affective^ and ability* Zt did not appear \ these tiad been fully 
communicated to the students andr in factr tie was not aware that they were not 
all achievenent criteria* The overall quality of speaking itself was an 
important evaluation variable^ yet this had been coamunicated to the students 
largely in far more specific termsr such as the direction to speak from notesr 
rather than reading* No rating syst^ existed for these reports^ to my 
knowledge * 

FUrtherr students did not appear to realize that they were also being 
graded on the basis of their answers to questions from their peers* Often 
they passed such a question on to a fellow presenter^ when they could have 
answered it too* That isr they did not active competitively in this regards 
although they were being judged^ not as a groupr but individually* They did 
try to answer the teacher's questions to the best of their ability* 

As to the written version of the report that the students turned in, it 
appeared to be less important than the classroom performance and it was 
difficult to ascertain what criteria went into judging the essay* The oa\y 
description Z got was that used for Paper and pencil assessments^ i*e*, that 
*'it all needs to be there*** Students did not appear to have a clear idea of 
how the compcnents-^ral presentation, question answer ingr and written report 
weighed in the overall assessment* 



C* O ral questions 

There was very little oral questioning in these classes* In history, 
questions averaged less than 2 per period* All were answered by volunteers; 
no scoring or other records were maintained^* Questions were inference, i*e*r 
could the student take the presentation the teacher was engaged in one step 
further* This contrasted with the basically recall assessment environment and 
the generally factual content ot the lectures* 



There was alniost never any verbal response to a student^s ar^^wer; the 
teacher siinply moved on in the lecture or^ in economics^ moved on to his nv%t 
question to the student presenter. 



V* FEEDBAOC PROCEDURES 

A# Oral and nonverbal feedback 

This teacher is r^arkably without affect. He varies his tone of voices 
his facial expression little* There is almost no eye contact with the class* 
Even admonishments to misbehaving students are very controlled* Indeed^ in 
the few cases in which such control actions were necessary^ he quietly moved 
up tc the offender^ without even being noticed^ and spoke in a quiet manner 
that conveyed strong approbation^ even barely controlled anger* Such actions 
had a strong effect on ti4e iiicividual and the class* The class was generally 
quiet andf if many were not tracking the lecture^ they were quiet and under 
control* 

Students resporsias to questions rarely evoked verbal ccimnent or even 
nonverbal comment. The fceacher asked a few questions of the economics oral 
report groups and soji'^times made a general coomentf such as *'thank your** *'that 
covered it^** andr oncer *'gooa work** when the group^s time was up* 
Interestingly^ he reported to me that he gave the economics report groups 
feedback inrntediately after they finished present ing~appar en tl> regarding 
these brief comments as sufficient feedback* 

On the relative isc>ortanc3 of feedback to the teacher ^ this case is very 
low and the case of the other social studies te cher is very high* 



B, Written feedback 

Some students* assignments got writtei. comments^ especially in the *'essay*' 
sections^ where language problems were noted* The written feedback was 
minimal, but certainly appropriate where used. 



VI, DESCRIPTION OF TEACdER a:*D ASSESSMEm' 

A* Teacher *s back<t^o u nd 

2, Two courses in college* 

This teacher would like more training in assessment and evaluation and 
specifically hope ould be an outcome of participation in the project, 

B* Teacpher's ext. jre of time 

Here I have c^nscrued ''teaching activities** to exclude time spent in and 
out of class on non*in0tructionally*r elated activities^ such as reading 
announcments • 
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2* Hote that assessments are developed before the term starts and all work is 
fully laid out* Assignments aire not developed by the teacher usually^ but 
drawn from text materials; some tests are used fran year to year* 

The following addresses how students^ time is spent^ at least their 
in-^lass time (for which we have data)* In these classes time usage breaks 
down as follows s 



HISTORY 
Instruction 



Assessment 



Other 



70% (Lecture is 90% of this; oral questioning 
10%) 

38% (One day a week is testing^ 20% of 

all class time; tests and grading are 
reviewed in class; assignments are not 
discussed in detail) 

2% (Little class time is used for other 
purposes) 



EOOnOHICS 

n*b* Results would be different at the beginning of the term^ 
before oral reports are the main activity* 



Instruction 



AsSi^ssment 



Other 



20% (Teacher follow-up to report topics; 

teacher expansion on questions he asks 
presenters) 

75% (Student oral reports constitute about 
70% of this total*; also unit tests; 
teacher questioning of presenters) 

5% (Occasional guest speakers^ as well as 
minor other factors) 



* I have counted the oral reports as assessment^ although they were the 
primary instruction on the topics as mil* 



C* Teacher character is tics 

This teacher highly values his autonomy as a professional in charge of his 
own classrOOT* His comments on his and his colleagues* opposition to testing 
standards indicate this* He sees it as his responsiblity to ccmmunicate the 
base content of the subjecc matter and how he does it is his decision* He 
also ccnmented that ^st of the social studies teachers are not happy with the 
text in current use because it is non*^rono logical and, while sane of his 
colleagues just don*t use the text, he chocses to do so sinc^ hz likes to have 
a text* 



ERIC ^128e 



• 



These are highly structured classes, activities fully laid out in 
advance* The only deviations from pre-planned structure that I obs«irved were 
the invitation of one guest speaker in economics (although the idea of 
occasional guest speakers is part of the term planr just when they will come 
is left open) and adjustment of the order of group report presentations due to 
student absence from class* 

The teacher expects students to become part of the classroom process, 
following the regular pattern of the weeksr knowing what is expected of them, 
and taking repsonsibility for themselves* He does not try to make overtures 
to students to motivate them, nor seek to know why they do not perform* This 
self -^responsibility or maturity factoi. appears to be an important part of what 
he tries to teach students in his classes* Thus, he sees his responsibility 
as ending when the material is presented and assignments and tests are clearly 
set and fairly administered* Students* failure to learn beccii s their own 
choice* Notably, he is open to amending assessments if students bring their 
difficulties to him, as he did when a group requested a different review 
assignment in history^ 

The teacher Lb cosmitted to assessing on the basis of achityvement, butr in 
fact, takes in some affective and ability variables as well* 

The curve system used for grading is partially criterion referenced, i*e*, 
50% is the minimum ever required for passing* The economics class is graded 
on a *C* minimum* The economics tests are curved, but the oral reports are 
criterion-graded* 



VII* T£ACH£lt*S PIUKCEPTIONS OF STUDENT CHABACTERISTICS 

The teacher generally regards most of these factors as either irrelevant 
9 or things that he should not pay attention to* His general approach appears 

to be to refuse to cater to student insecurities, variation^ etc«, in order to 
motivate th^ to rise above these things and take responsibility for learning 
the material of the course* His students get little feedback, but he feels he 
gives feedback* 

A Teacher's definition of success* Measured overtly only in achievement 

terms* The students have mastered a specified set of material* He has fairly 
and accurately evaluated and reported their progress* And, though not 
expressed, he looks tor the students to grow in ability motivation to do 
independent work* 

VIII* ORIGINS OF POLICY 
Testing 

States Minimum competency test in preparation, not yet used* 
Department: The department Is working cooperatively to prepare a position for 
# input to the state wide competency test; it has as its policy that individual 

teachers should decide their own requirements — *'We fought long and hard for 
academic freedom,* says the subject teacher* 
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Reporting (AND Grading) 

District: District requires grade reporting 4 times for 9-week periods. They 
do not require that a specific grade be tied to some specific percent* 
District also provides a **ccinments reports" cc^puter form with 20 affective 
and achievement comments to select from* 

School! Recoiranends that 50% be a passing mark minimum on any test* 
Homework 

SchooXt Teachers must send work hcma for any student who falls behind^ then 
contftct counselor^ andr at third stager request meeting with parents^ student 
and counselor* 

District! District policy is that schools must set up some procedure for 
consultation with parents by 5th or 6th week of a grading Period in which a 
student is not completing sufficient work to expect to pass* 

Class Si2 f 

District! There are "guidf^lines" but the union has not yet succeeded in 
setting contractual limits* 

Selection for Special Programs and Recognition 

District! Establishes criteria for accelerated and skills emphasis students 
and places primary responsibility on counselors* 

Schoolt Counselors select students for special programs^ but teaichers can 
laake reccomiendations and expect that their recamnendations will probably be 
followed* Teachers can dismiss unqualified students from their accelerated 
track classesr if they cannot or will not do the work* 
Departmental; The department staff selects all students for special 
recognition through vote at its weekly meeting* 

Attendance 

District: Policies are generally set by the district* 

School! Absence^ lateness rules are clearly set by the school and teachers 
are expected to adhere to then* Some teachers serve as hall monitors to 
intervene directly with tardy students* 

Content to be Taught 

State; Approves a list of acceptable texts to be selected from by the 
districts* 

Discrictj Approves a list of texts to be selected among by the schools* 
Department; Entire staff reviews and selects by vote among the offered 
texts* Teachers may deviate from the text (especially in accelerated classes 
like economics^ in which current periodicals are a major content source) r but 
many not use a different ^ext* 

Discipline 

District/Schooli All di.icipline procedures are specified by the district and 
applied to building conditions by the school administration* Building policy 
^ On what constitutes an excused or unexcused absense is firm* 
Department! By consensus the department arrives at methods by which to assure 
that activities out of school which they authorize are categorized as excused 
absences* 
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NOTE ON THE H£t4ATX0N OF POLICE AND AS&ESSH£»Tt l-aw Day 

Each year the social studies department sponsors a **l>aw Day*" in which a 
large number of students participate. Members o£ the senior applied law class 
and other social scudies students have the opportunity to spend the day at the 
courthouse^ observing trialsr hearing lectures by members o£ the legal 
profession^ andr generally, exploring the legal system and legal profession. 
Each year the social studies department encounters reluctance on the part of 
the foreign language department staff to sign the forms required to excuse l>aw 
Day participants from their classes. If students cannot secure an excuse from 
their classroom teachers^ they are not~according to strict school 
policy — eligible to make up missed work. If, for example^ a test is held on 
l>aw Day* unexcused students get a ^'zero*' for the test. In past years some 
students who failed to get excuses have suffered rather severely from ^'zeros*' 
on quizzes that the social studies faculty regards as having been scheduled 
specifically to punish Law Day attendees. 

This yearr the social studies faculty feels it is in a stronger position 
to secure excuses for the Law Day students^ since the foreign language program 
has a major event coming up shortly thereafter which will require excuses for 
student attendance. If Law Day excuses are not forthcoming, the social 
studies faculty will withhold excuses for that event in retaliation. 

Howeverr the faculty had concerns about students* behavior during Law Day 
and the legitimacy of getting excuses for the many students who leave the 
event shortly after it starts^ hanging out in an adjacent park instead of 
attending events^ or who siji^ly don*t show up at all. Should they take 
attendance at the event? Andr if sor at more than one point in the day? This 
vould assure attendance r since students not^ reporting vould be unexcused and 
therefore punished through ineligibility to turn in homework or make up tests 
for the day. The social studies department, after discussion, decided not to 
try to take attendance at Law Day, since reporting the widespread absence 
would damage the chances of continuing to secure excused absence forms fran 
non*social studies faculty, leading, eventually^ to the Actual attendees of 
Law Day being punished for participating in a legitimate^ sponsored event. It 
was better to not monitor, than to risk invoking school policy which counts 
absence negatively in student assessment. 
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PPOFILE OF SOCIAL STUDIES CASE #1 



I* ASSESSMENT PURPOSES 



A* Diagnosing individual 
student needs 



B« Diagnosing group needs 



C« Assigning grades 



D» Grouping for instruction 
within class 



E« Identifying students for 
special services 



F* Controlling and 
motivating students 



G. Evaluating instruction 



H. Ccmmunicating achievanent 
expectations 



Ohinformed X Well informed 

Irrelevant X_ Relevant 

Useless X Useful 

Hot used X Used frequently 

Ohinforned X Well informed 

Irrelevant X_ Relevant 

Usele ss X Usef u 1 

Kot used _X Used frequently 

Uninformed X Well informed 

Ir r e levan t X_ Ke levant 

Useless X Useful 

Not used X_ Used frequently 

Uhinformed X Well informed 

Irrelevant X_ Relevant 

Useless Hist Econ Useful 

Not used His t Econ Used frequently 

Uninformed X Well informed 

Irrelevant X_ Relevant 

Useless X Useful 

Not used X Used frequently 

Uhinformed X Well informed 

Irrelevant X Relevant 

Useless X Useful 

Not used X Used frequently 

Uhinformed X Well informed 

Irrelevant _X Relevant 

Useless X Useful 

Not used _X Used frequently 

Uhinformed JC Well informed 

Irrelevant X_ Relevant 

Useless X Useful 

Hot used X Used frequently 
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I* Coamunicating affective 
expectations 



J* Providing test-taking 
experience 



Uninformed X Well informed 

Irrelevant X Relevant 

Useless His t Econ Useful 

Not used His t Econ Used frequently 

Uninformed X Well informed 

Irrelevant X Relevant 

Useless _X Useful 

Not used Used frequently 



K. Relative importance 
of purposes 



Given "100 importance points" to distribute 
across the purposes listed belowr how vould 
you distribute those points to reflect the 
relative importance of the decisions listed? 



Diagnosing individual needs 
Diagnosing group needs 
^Assigning grades 
Grouping for instruction 
Identifying students for 

sp«^cial services 
Controlling and 

motivating 
Evaluating instruction 
Coeonuni eating achievement 

expectations 
Ccimnunicating affective 

esqpec tat ions 
Test taking experience 



60 



*40% grades; 20% measure achievement* 



13 



15 



100 points 
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II* ASSESSHEHT HETKQDOLOGY 
At Assessment of Achievement 



1# Teacher-developed paper and Uninformed X Well informed 

pencil tests and quizzes Inappropriate X_ Appropriate 

Use le BS X_ Use f ul 

Not used X_ Used frequently 

2* Text-embedded paper and Uninformed X Well informed 

pencil tests and quizzes Inappropriate X_ Appropriate 

Use le ss X Use f ul 

Hot used X Used frequently 

3# Performance assessments Uninformed _3C Well informed 

I nappr opr i ate Appr opr i ate 

Useless Hist Econ Useful 

Not used Hist Econ Used frequently 

4# Oral questioning strategies Uninformed _X Well informed 

I nappr opr i ate X_ Appr opr i ate 

Useless X ^ Us'iful 

Not used X Used frequently 

5# Standardized testa Uninformed X Well informed 

Inappropriate X Appropriate 

Useless _X Useful 

Not used _X Used frequently 

6* Group assessment Uninformed X Well informed 

methods Inappropriate X_ Appropriate 

Useless _X Useful 

Not used X ^ Used frequently 

7* Opinions of other teachers Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Not used X [ Used frequently 

8* Assessment of reasoning Uninformed X Well informed 

skills Inappropriate X_ Appropriate 

Useless X Useful 

Not used X Used frequently 

^ 9* Regular assignments Uninformed X_ Well informed 

I nappr opr i ate X_ Appropr i ate 

Useless X_ Useful 

Not used X_ Used frequently 
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10. student peer rating Uninformed _X Well informed 

I nappr opr i ate X Appr opr i at e 

9 Useless J£ Useful 

Not used _X Used frequently 

11. Student self ratings Uninformed Well informed 

Inappropriate X Appropriate 

^ Useless _X Useful 

Not used JC Used frequently 

12. Proportion of all assessments for all purposes that are of various types 

History Econ 

• Teacher-developed paper and 

pencil tests 60 40 

Text*embedded paper and 

pencil tests 5 0_ 

Performance assessments 0 30_ 

Oral questions 2 10 

^ Standardi2ed tests 0 0_ 

Opinions of other teachers 0 0_ 

Eegular assignments 33 

Group assessments 0 

Student peer ratings 0 0_ 

Student self ratings 0 0_ 

• 100% 

13. Cognitive levels of questions posed in: 
(t4.B. Hestatement of categories) 

Study and Oral Tests and 

• Assignments * Discussion Questions Questions** Qui22eg*** 

Text-£mb. Teach. Devi. History Econ Actual Hake-up 

Recall 70% 74% 100% — 28% 99% 70% 
Analysis — 6% — — 28% 

m 

Comparison 20% 2% — — 17% — 30% 

Inference ~ 4% — 100% 5% 1%**** ~ 

Evaluation 10% 14% — — 22% 

^ Both text-embedded and teacher-developed. 
** t4 here is extremely small; little oral questioning occurs. 
**^ Actual tests are fill-inr multiple choicer setting events in chronological 
order r matching setsr and short essays of 5 points value. Make-up are all 
short essay. 

0 **** In one instance only^ in accelerated economics^ a single inference question 

was included. 
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14. Strategies for integrating Uninformed X Well informed 

assessment and Inappropriate X_ Appropriate 

0 instruction Useless X Useful 

Not used _X UseJ frequently 



15. Dealing with cheating Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Not used X_ Used frequently 

B. Assessment of Affect 

1. Observing individual Uninformed X Well informed 

students Inappropriate X Appropriate 

Useless X Useful 

Hot used X Used frequently 



2. Observing group Uninformed _X Well informed 

interactions Inappropriate X Appropriate 

Useless X Useful 

Not used X Used frequently 

3. Using questionnaires Uninformed Well informed 

Inappropr iate X Appropr iate 

Useless Jt Useful 

Not used _X Used frequently 

4. using interviews {formal Uninformed X Well informed 

and informal) Inappropriate X Appropriate 

Useless Jt Useful 

Not used _X used frequently 



5. Opinions of other Uninformed X Well informed 

teachers Inappropriate X Appropriate 

Useless X Useful 

Not used 25 Vse^ frequently 

6. Opinions of other Uninformed X Well informed 

students Inappropriate X Appropriate 

Useless _X Useful 

Not used Jt Used frequently 
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7. Opinions of parents 



6. Bast student records 



Uninformed X Well informed 

Inappropriate X ^propriate 

Use iB BS _X Use f u 1 

Not used _X used frequently 

Uninformed X Well informed 

Inarpropriate X ^propriate 

Useless _X Useful 

Hot used X Used frequently 



9. Checklist of affective characteristics measured (considered): 



Seriousness of purpose 

Motivation and effort 

Attitude 

Learning style 

In teres ts 

Values 

Preferences 

Academic self -concept 

Locus of control 

Anxiety 

Maturity 

social skills 

Study skills 

Other (specify* confidence 



Code ; 

F " formal assessment conducted 
I ^ informal assessment conducted 
X » Hot measured 



10. Relative importance of affective assessment methods: 

Observing individual 

students 
Observing group 

inter aict ions 
Using questionnaires 
Using interviews 

(formal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Past student records 



60 



10 



100% 
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C. Assessment of Ability 



1. Meaning of ability for teacher 
Value oi: this factor 
for the teacher 

Measurement of ability 



Important X 



Measured formally 
Measured informally 
Not measured 



Unimportant 



Ingredients considered in assessment of ability^ if measured: 
PACTOR{S) INCLUDED X» ASSESSMBNT 
Verbal ability 
Concentration 
Spacial ability 



1. 
2. 
3. 
4. 

5. 



Organizing capability/ability to 
comprehend overall principles 



MEASURED HOW?~none really 

measured 
public speaking in oral 

reports 
General on-task behavior^ 

questions asked 
Quickness with map-reading 
tasks 

Structure of oral econ reports 
and econ report handouts 



2. Check decisi<^8 influenced by results U.e.^ change with varying levels of 
ability). 

Instructional objectives 

Instructional strategies 

X Grouping for instructiM (within class) 

Methods for measuring achievement 

Grading standards 

X Students selected for special services 
Other (specify ) 



0. Text Assessments 

Checklist of assessment ccroponents provided with text 



H 



Oral questions for class use 
Homework assignments 

General assessment guidelines for teachers 

paper and pencil tests 

performance assessments 

Scoring guidelines 

Quality cc^trol guidelines 

Other (specify 
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Ill* CRITERIA FOR SELECTIHO ASS£SSH£NT METHODS 

A» Results fit purpose Uninformed X Well informed 

Un impor tan t X__ Impor tant 

Not used X__ Used frequently 

B» Methoa matches material Uninformed _X Well informed 

taught Un impor tant X_ Impor tant 

Not used Used frequently 

C» £ase of development Uninformed X Well informed 

Unimportant x Important 

Not used X Used frequently 

D» Ease of scoring Uninformed X Well informed 

Un impor tan t X Impor tan t 

Not used X Used frequently 

E« Origin of assessment Uninformed X Wfell informed 

Unimportant X_ Important 

Not used X Used frequently 

F» Timo required to Uninformed X Well informed 

administer Unimportant X_ In^rtant 

Not used X_ Used frequently 

C* Degree of objectivity Uninformed ^X Well informed 

Un impor tant X^ Impor tant 

Not used ^ [ X_ used frequently 

H. Applicability to Uninformed _X Well informed 

measuring thinking skills Unimportant X_ Important 

Not used X_ Used frequently 

I» Effective control of Uninformed X Well informed 

cheat ing Un impor tant X Impor tant 

Kot used X Used frequently 
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J* Relative importance of criteria 



Results fit purpose 20 

Method matches material taught 20 

Base of development 5_ 

Ease of Scoring 10 

Origin of assessment 2 

Time required to administer IS 

Degree of objectivity 10 
Applicability to measuring 

thinking skills IS , 

Effective control of cheating 3_ 

100% 
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IV* QUALITY OP ASSESSMENTS 

A# Percent of paper and Pencil asseggments (teacher-developed or text-embedded) 
having the following characteristics (ri< not total 100%): 

% 

90 Cltar description of assessment specifications 

w Hatches content of instruction 

60 Matches cognitive levels of Instruction 

?0 Minimizes time re<julred to gather needed information 
. ^60^ Item format matches desired outcome 
9JL^ Items clearly written 

9 0 Items sample domain 

95 Scoring prrcedures planned 

notes Scoring criteria written for e33ays 

90 Clear directions 

90 High quality reproduction 

?0 Test scheduled to minimize distractions 

B* Percent of performance assegsmenta having the following characteristics: 
% 

10 Clear description of trait to be measured with levels of 
proficiency articulated 
, 30 Matches intended outcomes of instruction 
50 Minimizes time required to gather needed informrtion 
70 Clear performance criteria 
30 Students aware of criteria 

60 Thoughtful exercises yield performance samples 

30 Exercises sai^le performance domain 

40 performance rating planned 

30 Results match information needs 



C« Percent of oral questions hiving the following characteristics! 
% 

, . 3 0 Sampling methods cover range of achievement levels of students 

10 Strategies involve everyone 

95 Teacher waits for response 

20 Student's response given supportive reaction 

30^ Questions match cognitive levels of instruction 

10 Written performance records maintained 
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V. CISEDBACK PROCEDUKES 

A, For oral and nonverbal feedback 

Percent of feedback deli\ered to students who are: 
% 

70 Strong {vs. weak) 

70 Correct (vs. incorrect) 

70 Male (vs. female) 

Percent of feedback having the following characteristics t 
% 

95 Delivered in class (vs. out of class) 

^0 Oral (vs. nonverbal) 

, 90 Public (vs. private) 

90 Pair {vs. unfair) 

90 Focused on rjiAevanent (vs. affect) 

90 Germane (vs. irrelevant) 

90 Immediate (vs. delayed) 

70 Positive (vs. negative) 



B. For written fa'-r^bacSc 

Percent of feedb.^k delivered to studeits who are: 
t 

50_ Stror.:; (vs, weak) 

50 Cotuect (vs. incorrect) 
50 Male (vs. female) 

Percent of feedback having the following characteristics: 
% 

20 Comment (vs. symbol) 

40 Positive (vs! negative) 

90 Pair (vs. unfair) 

90 Germane (vs. irrelevant) 

95 Focused on achievement (vs. affect) 



Uses samples of performance Never X Frequently 

as feedback 



Uses public achievement chart Never X Frequently 

as feedback 
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VI* DESCRIPTION CF TEACHER AND ASSESSMENT 

A« Teacher's background 

1* Teacher experience* number of years: 



"21 



Overall 

At grade level 
In school 
With content 



2. Relative contributions of various sources to teacher's knowledge of assessment 
methodology 



% 

10 



10 



2 

100% 



Teacher preparation training 

Inservice training 

Ideas and suggestions of colleagues 

Professional literature 

Teacher *s guide to textbooks 

Own experience in classroom 



B. Teacher*£i expenditure of time 

1. Proportion of tiJfte spent in teaching activities 



2S_ Planning 

2 Iteaching (one on one) 



51 Teaching (group) 

20 Assessing (see list below) 



i_ other (specify ) 

100% 

2* Proportion of time spent in assessment activities (paper and pencil* performance 
assessment, oral* assignments) 



% 

10 



30 



Reviewing and selecting assessments 
Developing own assessments 



j.8_ Administering 

35 Scoring and recording 

5_ Providing feedback 

2_ Evaluating quality 

100% 



C* Teacher characteristics 



Role in the classrooi» 



Curriculum maker 
and presenter 



Servant of policy 
delivering 
required content 



Ierlc 
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Expectations o£ Expects a 

proeessional self Expects XittXe X_ 9reafc dedX 

Structure needs Rigid J£ Flexible 

View of high Correctness Degrees of 

quality performance demanded _X quality eval* 

Stereotypic view of students None X Expressed often 

Attends to exceptional student Kever X Frequently 

Sense of performance norms Unclear ^ X_ Very clear 

Orientation to experimentation No risks X,^ Risk taker 

Orientation to cheating No concern X Major concern 

Amount of cheating None X A great deal 

Value of proB^tnessi importance 

of timely work ccwpletion Unimportant X^^ Important 

Interpersonal environment of 

the classroom regarding assessment! 

Cooperative None X Frequent 

CcMRpetitiv^ None Frequent 

Attributions for reasons of 
student success/failure: 

70 Due to student 
30 Due to teacher 
100% 

fiasis for grading students* 

5_ Sense of ability 

9S Demonstrated achievement 
100% 

Interpretation of assessment: 

SO , Norm- referenced 
SO Criterion-referenced 
100% 
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VII. TEACHER'S PERCEPTIONS OP STUDENT CHARACTERISTICS 

A. Ability to learn Low X High 

No variation JL Great deal 

Variation ignored _X Addressed 

B. Willingness to learn Low X High 

No variation 3L Great deal 

Variation ignored X Addressed 

C. Rate of achiev^ent Low X High 

Decreasing X Increasing 

*to variation JL Great deal 

Variation ignored X Addressed 

D^ Maturity Irresponsible X Responsible 

No variation X_ Great deal 

Variation ignored X Addrrjsed 

E. Study skills Uhdeveloped X Developed 

No variation ^ X Great deal 

Variation ignored X Addressed 

Serial skills Undeveloped X Developed 

No variation X Great deal 

Variition ignored _X Addressed 

G. Willingness to perform Reticent X Willing 

No variation X Great deal 

Variation ignored ^J£ Addressed 

H. Feedback needs Wfeak X Strong 

He variation X Great deal 

Variation ignored _X Addressed 

I* Self^assessment skills Undeveloped X Developed 

No variation X Great deal 

Variation ignored _X Addressed 

J* Sense of fairness Unclear X Clear 

No variation X Great deal 

Vari^tion ignored X Addressed 
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K* Beactlon to testing 



L« Parental expectations 



Tr anqui 1 X Anxious 

No variation X Great deal 

Variation ignored _X Addressed 

Unclear X Clear 

Low High 

Unimportant X Important 

No variation X Great deal 

Variation ignored JC Addressed 
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SOCIAL STUDIES CASE STUDY #2 



Background Information 

This social studies teacher is on the staff of a four-year high school 
that serves an urbanr working class neighborhood. This observation was 
conducted on 10 days in April and May^ 1966. Interviews with the teacher took 
place prior tor during^ and after the observations. 

He teaches five classes daily^ three junior-level American history courses 
andr in the latter half of the yearr two senior econcmics courses. In 
addition^ the teacher is responsible for holding one period of study hall. 
The schocl day is made up of eight class pariodSr each lasting 46 minutes^ and 
a brief lunch break. Ttie first period is extended by six minutes to serve as 
the homeroom period for announcements and related activities. 

All are courses required for graduation. In 1985*86 this teacher has all 
general courses r although he usually has had at least one accelerated group. 
However, each class has a few ''Skills Emphasis'* students. These are 
individuals who have been identified by school counsellors as needing extra 
attention to their writing (he offers a Southeast Asian boy as an example). 
For these students the teacher prepares and offers cqpportunities to rewrite 
assignments^ extra writing work and extra-credit workr ana more extensive 
written comments on work submitted for grading. These students are identified 
only cn the class lists and are not themselves aware of the designation. 

nie students in the subject teacher's classes are approximately 65% whiter 
30% blackr and 5% non^white immigrants predominantly Southeast Asian. Girls 
and boys are present in about equal numbers. 



I. ASSESSMENT PURPOSES 

A. Diagnosing individual student needs 

At the beginning of the year^ usually during the first class weekr the 
teacher gives all his classes two writing assignments that he uses to size up 
the students. These are short-essay exercises^ '*less factual than opinion arid 
evaluation questions'* from which he draws conclusions about students' level of 
interest. It does notr he points outr measure their ability. One assignment 
is coinpleted in classr the other is a homework task. The latter gives more 
opportunity to those who are slower thinkers or writers and the former assures 
that it is the students* own work and ideas. 

niis year the sizing up assessment consisted of three questions r all 
having to do with current events. If the assignment were given during the 
period of the observation^ he offered by way of -example r he would have asked 
the students to discuss the American bombing of Tripoli r an event very much in 
the news at the time. He is testing for '*what they knov'* and "general 
con^etency. '* This contrasts with social studies case #lr a teacher who has a 
sense of graduated ability. 
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Having administered his own assessment, he then cotnpares these results 
with school records of some student^i' overall achievement and reading grade 
level* **I*m suspicious of reading ability** discrepenciesr he reports^ and 
histories of frequent absence from school* The ccnnbinations of his own 
assessment and student records give him **an identification of where they 
should be** in the class* 

These conclusions canr he explains, override the results of any specific 
disappointing assessment outcones during the yearr since **l KUOW what their 
performance has been and that they CAN do itr but don't*** He follows up with 
such students in conference* 

Begular homework assignments and tests are also used to diagnose 
individual student needsr however the expectations are generally set from 
these early sizing up activities* If shifts in quality of work are noted, the 
teacher requests a conference with the student* 

B* Diagnosing group needs (See also l*G* — this is overlap) 

Lessons in these classes were largely outlined in advance and the class 
proceeded through the material on a pre-set schedule* Therefore, little 
evidence was seen of use of assessment to diagnose needs of the group for 
recapitulation, further explaiHttionr etc* The teacher^ however^ contended 
that he did repeat material **in a new guise,** if assessment results revealled 
that many of the students had not learned important subject matter* He 
described this process as one in which he reevaluates questioning strategies, 
reemphasises the critical points when reviewing for the test and**ttost 
importantly — retests the material* That is, the students are retaught and 
retested without overt reference to the repetition* He says he doesn*t say 
he's repeating because students vill think it is boring or feel he is saying 
they were stupid to not get it the first time* 



C* Assigning g Lades 

This teacher was recocomended to the study by his principal because he is 
well-kiK)wn for the clarity and con^leteness in his grading system* Grades are 
highly salient in this classroom* Students regularly ask questions about 
grading^ the teacher frequently discusses grading* 

The grading syst^ is a cumulative total of points for the year* At the 
point the observation beganr there were 1^273 possible points fran assignments 
and tests thus far in American history* Economics was at about 600 points, 
since it is a half-year course* 

At different points during the observation the teacher offered two 
different synopses of the basis for his grading* In the first interview he 
reported grading approximately one-third each on hcmework assignments^ testsr 
and projects* In a later discussion he offered one*third each frcxn testsr 
assignments^ and class participation as the breakdown* By school policy there 
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is a final exam in American history. His final can constitute up to 30% of 
the year's gradef but it is usually more like 10% of the point total. During 
the observation, points were assigned for testsr hcfneworkr responses to 
questions posed in class discussion^ and oral report projects. 

Students are very concerned with their point standing. The teacher has 
restricted inquiries about point totals to once a week and many students 
availed th^selves of times such as in-class reading to go up ana ask for 
their grade standing. The teacher maintains an accessible assignment book 
with extra copies of hoaework that absent students are required to consult 
when they return to school, niey then have one or two days to submit the 
missed assignments, HOrk not made up counts as zero in the point totals but 
students can negotiate these terms with the teacher if there is ^ood cause why 
they cannot complete all the work. Students vho are not satisfied with their 
grades are offered opportunities to undertake extra credit projects. These 
cannot make up more than 10% of the student^s point total* 

It remained somewhat aysterious what the teacher included in '*extra 
credit*** in response to interview questions^ he described only extra work 
ci^rtunitiesr but when handing back tests noted twice thatr '*There was no 
extra credit and that's the way I like it*** 



D, Grouping for instruction in class 

This was rarely done* The teacher reported that he assigned students to 
small groups for oral reports based on his assessments* But, it was less on 
the basis of hcmo* or heterogeneous achievement or perceived ability^ than the 
hope that an industrious student would motivate a less interested classmate to 
dc the work. 



E, Identifying students for special needfi 

This teacher would do thisr if he were authorized, and believes his sizing 
up assignment would Provide a valid basis. However , counsellors have the 
responsibility of grouping and teachers* recommendations r according to the 
informants are rarely followed, Sor he doesn't try to get students replaced 
very often any more* He does speak with a few students each fall to encourage 
theiL to apply for accelerated placements sometimes successfully. 

One example that the teacher gave of the problem of an improperly placed 
student was of an outspoken class metaber whom he characterized as ''dcminating" 
end using ''gapping logic,** In an advanced classr these problems would be 
addressed^ so he would get the help he needs. He had tried to pursuade this 
boy to take accelerated history, but he had not wanted to shift his placements 
since the school year had already begun. The teacher thinl^s he lacked 
confidence^ blaming the placement process. The teacher gives this boy extra 
projects out of class to try to help him realize his.poten^al. 
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F* Controlling and motivating students 

The subject teacher uses assessment to both control and motivate; however^ 
he only recognizes the motivating function of his assessments* An upcaning 
test Ld mentioned frequently as a spur to reading and homework preparation* 
When students receive their graded assignments back to corrects the possiblity 
of those same questions appearing on the unit test is announced* On one 
occasion^ when handing out an assignmenti the teacher urged the class to 
really put some effort into it and prcsiised^ if the homework results showed 
sufficient understanding of the materials he would not give a chapter test 
that weekr but merely integrate the chapter into the three^hapter unit test 
that would come up later in the month* Tliusr assessment it used for 
motivating the class, both positively and as punishment* 

Mditionallyr ne9ative reporting is omittedr in order to motivate* The 
school provides forms to advise students and their families of impending 
failure for the grading period* The subject teacher pointed these forms out 
as an example of negative effects of grading* He does not send failure 
warnings^ rather he calls the student in to conference and then calls the 
parents to discuss ^progress** and ^^improvement needed^** rather than failure* 

During class periods^ assessment is frequently used to control the class* 
The unrulyr the uninterested^ the sleeping may be called upon^ out of any 
pattern of orders to recite in class* Since the teacher re9ularly records 
responses to questions in his grade bookr questioned students are put on 
notice that their behavior has an impact on their grade* 

0* Evaluating instruction (see also I*B*r diagnosing group needs**scme 
overlap) 

nie teacher responded inconsistently* Asked whether he ever changed 
instruction based on assesamentr the subject reacher replied^ ^constantly*** 
But (as the discussion under I*B* has detailled), this was not apparent* In 
an earlier interview^ when asked whether daily assignment results might 
influence instructional decisions^ he construed the question to refer to 
further assessment decisions and stated thatr while homework would rarely 
alter what he would do in classr its results **tell me i/hat I need to test 
for** That isr assessment is used to plan assessment* 

It seems improbable that major revision of instruction was undertaken^ 
since a pre*set schedule for material co^^erage was closely adhered to^ but 
perhaps specifics of lecture and discussion were amended based on test 
results* Be*introduction of widely-missed questions into a later test wasr 
indeedr apparent* (See I*B*i abover for details of observation*) 



H* Communicating achievaaent expectations 

Observed only in remarks to hhe classes that they should **know this for 
the test*** 
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I* Coimmnicatlng affective expectatlona 

At the beginning of the yeac the teacher set standacdd for behavior and 
for affective characteristics s^icn as efforts seriousness^ neatness in his 
three^^ge "Classroom Procedures" manual* Written assignments^ for example^ 
are required to be in penr to be neatr have specific margins* Students can 
lose points if the don*t follow these rules; during the observation^ a student 
lost poinf: because he had not remembered to put his name on the assignment 
papers* 

Within an apparently rigid grading systoar in which each piece of paper^ 
each question has a point valuer the teacher allows for extra credit and gives 
some extra points for improvement* As he says to the classr as veil as to me 
in interviews no extra points is "the way I like itr" but sometimes it does 
happen* Be gave fairly substantial credit to a couple of students for 
extroRely marginal extra-credit reports^ because they finally showed 
themselves willing to take on the job and he had been trying to get them more 
interested all year* 

The teacher also guards against lowering academic self-corcept through 
grading and reporting of failures* He takes special care to find some things 
to conment positively on in assignments and tests of students be is trying to 
encourage* And^ generally^ be does not count off for poor spelling and 
syntax^ although he regards it as his duty to mark than* If he counted off 
for those things^ it wnuldr be feelsr discourage effort and interest andr 
especially^ cause the students to write lessr when he is trying to get than to 
write more* 



J* Providing test^-taking experience 
Not apparent 

II* ASSESSMENT METHODOLOGY 
A* Assessment of achievement 

1* Teacher*devc2oped paper and pencil tests and quizzes 

These are short answer^ matching exercises^ identifications* The teacher 
likes Nriting" tests^ as the students are ^more creative**' 

Be tests every 5 to 6 days* These are chapter tests* Unit tests cover 
about three chapters of text and occur at least onc«» a wOnth* 

2* Text*embedded paper and pencil tests and quizzes 

The text*embedded materials are use more for homework assignments^ which 
are also graded* He is concerned about security of tests and this book has 
been used now for five yearsr so be regards it as no longer useful* And^ the 
true/false^ fill^in^the^blankr definition sorts of questions in the text 
materials he thinks of as more suited to assignments preparatory to testing* 
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3* Performance assessments 

The two performance assessment methods regularly used In this classroom 
are oral questioning as a measure of attention^ etc* and student oral 
reports* Oral report days take up one to two class days per chapter in 
economics^ i*e* one set approximately every tm weeks* The teacher judges 
seniors more capable of this %fork than younger students* In history they are 
somewhat less frequents but used as the basis for "current events day" every 
third Friday* 

In the oral reports a small group of 2-4 is asked to read on a topic orr 
in economics^ to prepare one of the textbook's "case studies" (small examples 
of actual cases of application of the economic principles under study}* The 
students are expected to suraoarizer to answer pre-set questions^ and~at least 
in theory — to lead the discussion* In factr the teacher regularly preempted 
the student-led discussion (sometimes despite student complaint) to conduct 
his urual routine of oral questioning^ addressing his questions exclusiv«»ly to 
the presenting group* 

These oral reports are graded* The teacher reports he looks for contents 
denionstration of understanding of the reading.^ and research accomplished r if 
that was part of the assignment* The students are required to hand in the 
notes they report from and these constitute one-third of the grade* 
^hfo-thirds of the credit is based on the pertormance* 

Questioning turn strategies varied considerably from day to day* On a 
grading day he often picks out five to seven students to "concentrate on*" 
This becomesr for that groupr a major assessment of class participation—which 
he reports may constitute a third of their grade* Other times he may just go 
down the rows^* recording responses* 

At still other timesr when he is not trying to assign a specific number of 
points or keep track of number of cqpportunities to recite, he takes a mixture 
of volunteers and called*<)n students* Usually^ volunteers c^n answer the 
questions, called*K)n0 cannot* Calling on students who are not paying 
attention is a commonly used motivation or disciplining tactic* Boys recite 
morer both in volunteering more often and being called on more often* After 
such general questioning sessions^ the teacher often records point marks for 
recitation after class for students who have recited a lot or often called onr 
apparently based on some generaJ impression of their participation* 

4* Oral questioning strategies 

Oral questioning is the most common use of class time* This is how the 
teacher instructs the students on the text material* He rarely lectures^ 
although sometimes a longer discourse sets the stage for a series o£ 
questions* Itesponses become part of the grade; at least twice a week tbe 
teacher has his grade book right at the lectern and records every correct and 
incorrect response* Other days the teacher mayr after classr write down some 
credit for students who have been participating well* 



S* standardized tests 

Standardized tests are not administered in the social studies 
department* This teacher viould like to see one created, but his colleagues 
are not interested* He is looking forward to the imposition o£ a state 
minimum competency test for social studies* 

6* Croup assessment methods 

These are not a major feature of the classroom* In the oral reports, 
some consideration is given to the fact that it tias been group mrk, but to 
the extent possible^ the efforts of each monber of a reporting group are 
individuated* 

7* Opinions of other teachers 

This teacher has virtually no contact with colleagues* There*^ are no 
scheduled meetings of the department* Their only joint work this year has 
been selection of the new tJ*S* history te.;^tsr a committee on which the 
subject teacher sits* He does not seek out any formal or informal 
consultation with colleagues andr in fact, only very rarely leaves his 
classroom* 

8* Assessment of reasoning skills 

The teacher acknowledges the importance of testing for a variety of 
skills^ noting that the principal holds this as a high priority* The 
schoolHnandated final exam in American history is checked over by the 
principal and thisr the teacher reports^ is what he is looking for* 
Otherwise^ ^he teacher does not setm to be too concerned on a day-to-day 
basis with r'^asoning skills* He appears to regard use of his own short 
answer (Writing*) testsr as opjposed to the text's multiple choice, 
true/f&lser and idenif ication tests as sufficient* 

9* Regular assignments 

This teacher gives three to four graded homework assignments weekly* 
These are intended to assure preparation, to focus students* attention on 
what he regards as the major points of the reading^ and to give him an idea 
of %here they are* in their comprehension of the material* Considerable 
class time is devoted to oral questioning for correcting missed answers on 
returned ascignments, which then are turned in again* 

Host assignments are text-embedded materials^ though the teacher also 
makes use of questions he writes himsel£'> 

10* Student peer rating 

Hot used* 
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11. student self rating 
Kot used. 

14. Strategies for integrating assessment and instruction 

The only things I can think of here are oral reEK>rtSr i.e. covering the 
material through graded student performancer oral questioning^ oral 
correcting of assignments and tests. 

15. Dealing with cheating 

There are strict rule^ for make-up tests and assignments that are 
designed to inhibit cheating. Make-ups are almost always different from 
scheduled tests and are changed frcsi year to year. 

Soae students are placed in front seats or away from friendsr in order to 
limit their cheating from one another. During tests^ students whose desks are 
too close are asked to move* During tests^ however^ the teacher works at his 
desk most of the time and does not monitor the class closely; cheating is 
raiqpant. 



B. As sessment of affect 

1. Observing, individual students 



Sleeping^ acting outr etc* are monitoredr sometimes addressed^ and 
occasionally beccoK; part of the students* assessment* The teacher ^ when 
annc^ed^ calls on a misbehaving student for an answer to an oral question^ 
km>wiiig that the student will have no idea what the question was. The 
failure to respond correctly is recorded^ often with an oral admonishment. 

The teacher makes use of the 20-statement multiple choice supplement to 
the grade report. It consists largely of affective statements* Even though 
he * critical of the form^ he tries to check at least one stat erne tit»u sua lly 
something about 'in-class behavior* on each report. 

2. observing group interactions 

Not used. Students are not expected to interact in this class; it is 
vety teacher -student oriented. 

3. Using questionnaires 
Not seen. 

4. Using interviews (formal and informal) 

This teachci relies extensively on conferences with students. 5ome of 
these take place during class time^ when the rest of the group is i^orking on 
reading or homework. Host are held privately^ before and after school and 
during the teacher *s free periods. Several student conferences were 
scheduled evety day during the observation period. 
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At these conferences^ students review their progress^ check on their 
gradesr request extra credit discuss their in-class behavior (at the 

teacher's request) , and may talk about problems outside of class that are 
iitipacting their success. The teacher regards family and Personal problems as 
a major determinant of student achievement and classroom behavior and seeks 
to draw this information cut of the students^ in order to take it into 
account in decisions about, for example^ delaying due dates for work, 
permitting extra credit, and allowing repeat of i#ork. 

5. OpinioTiS of other teachers 

Generally^ neither valued not sought. However^ the teacher does look 
through student records in the main office at the beginning of the year. 
While test scores are his primary interest, he does occasionally find remarks 
of former teacher; helpful in his own sizing up process. 

6. Opinions of other students 
ll6t valuedr in fact avoided. 

7. Opinions of parents 

^is teacher tries very hard to engage parents* interest in their 
children's educational process. He keeps a list of all home phone numbers at 
his home telephone and makesr he estimates^ an average of about three parent 
calls each night. He is interested in the parents* assessment of their 
child, but more important is their level of commitment to assisting the 
teacher by monitoring hcmeMrkr encouraging the student, etc. 

The teacher recalls cases in which his and parents* opinions of a 
student's ability were in disagreement— parents both underestimating and 
overestimatina the child*s potential. He tries to get parents to think as 
highly of their children as possible, since he regards motivation and 
self-confidence as keys to success. 

8. Fa&t student records 

Records are used only for sizing up of students whan he feels may be 
misplaced or may have sane serious reading^ writing^ or other academic 
problem. He consults the school records in the third week of the year, 
looking especially at overall achievement results and reading test scores. 
He regrets that these data are not current for his students. Occasionally he 
finds teacher comments in the files of value as well. 

9. Itone of these aspects are 'measure^!*. This response reflects what the 
teacher takes into account, based on general in^ressions gained through 
classroom observation and conferences with students. 
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C* Assessment of ability 

1* Meaning of ability 

Potential to perform the workr if the student has 
favorable environmental conditions and motivation; a^onstrated by verbal ana 
writing skills ana general loiowleage* 

Although the teacher insisted he was not measuring anything but 
achievement in his grft^esr two inconsistencies emerged* One is the question 
of extra credit (see X*C*r above)* The second is the differing amount of 
personal effort he was putting into his students on his own time* Asked why 
he spent so much time cajoling, enoouragingr and meeting with one students he 
responded that the boy is *^brightr*^ though he misses lots of class and does 
not do the mrk* With regard to another, rather disruptive studentr the 
teacher pointed Mm out to me as someone with more *^ability*^ than his work 
evidv^ncedr judged from the boy's verbal skill* He was able to discuss 
current eventsr making liis points emphatically^ if not argumentativelyr 
although he did not read the assignments* 

2* Decisions influenced by results 

In this response, instructional strategies that are obviously influenced 
are calling students in for oonferencer expending tuctra effort one-on-oner 
offering extra credit work and agreeing to requests for extra credit 
assignments* Oral questioning appears to be influenced as wellr student^ 
whom the teacher regards as *^bright*^ often called on when they are 
daydreaming or misbehaving^ in order to try to bring them on task (either by 
embarrassing them or by reminding them of his belief they can do it)r while 
other off'^task students are singly ignored or verbally admonished* Grouping^ 
for instruction is affected by the teacher's desire to put some of these 
students with unrealized potential into groups with high achieving and/or 
hard working students, in order to evoke their participation in the task* 



D* Text assessments (See II*A*13 for details, this is overlap*) 

Tiext tests are not used, but only because of concern for cheating^ not 
test quality* All text*embedded assessment materials reviewed were all 
recall* 



III* CRITERIA FOR SELECTING ASSESSMENTS 

Criteria for selecting assessments were difficult to discern* The 
teacher was not articulate about this iu interview, indeed, appeared to 
reg&rd the query as irrelevant to his work* I conclude that the selection of 
assessment methodology is fixed by long practice and not subject to review on 
his part* The teacher regards all his assessments as fully objective^ 
whether paper^andlpencilr oral reports r or class recitation* 
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Hie considerations that did surface had less to do with the 
appropriateness of the method to the contents than with perlferal Issues. 
For exanplef he loade up hla own paper-and-pencll tests because those that 
came with the t^tbooks had been used before. Next year# when they have a 
new textf he may use th^. fie noted ease of scoring as a factor^ as well as 
time it takes In the classroom. These factors seem to determine how many 
questions are given and limits writing to short re^nses. 



G. Deqr^fe of objectivity 

nie teacher belle\ ^s that objectivity is the crucial factor in testing 
and that all his assessments and his grading systen are coi^letely 
objective. It is unclear where some of the extra credit points fit into this 
scheme. Apparently it is at least partly out of concern for objectivity that 
the teacher restricts his testing to recall. 



IV. QpALITY OF AtiJESSHEHTS 

{I have construed the percentages as proportional ratings.) 

A. Paper-and-pencll assesgm^g^ g 

Cognitive levels: Text-embedded study questions for a sample history 
chapter consisted of 21 recall questions and 26 definitions. All quizes and 
tests observed were recall short answer questions. Assignment sheets^ 
text-embedded or teacher -developed were recall. 

Assessments did tend to match the instruction^ since it was by and large 
recall as mil. In history class oral questioning sessions^ three-fourths of 
the questions were recall. In economics recall was solicited in about 
two-thirds of the questions. Other ques'clons called for opinions from the 
students^ primarily evaluation and comparison. 

Directions^ Students have plenty of opportunity to ask for 
clarlf Icatlonsf before and during work on assignments and tests. Directions 
are quite clearly outlined verbally. 

See II.A«13f above* 

^e classroom procedures manual details the grading systen; what percent 
of points are required for each grades what will be graded^ hoiv credit is 
apportioned. 

Reproduction: Teacher -developed assessments^ printed on the teacher *s 
dot-matrix printer^ contained some errors ot spelling and syntax. Whether 
written on the board or from his computer^ all assessments are legible. 
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B* Perforinance assessiBents 



The clarBiCom procadures manual gives vritten definition of how the oral 
reports are to be constructed and how much they county but does not offer the 
strategy for evaluating them (one-third for notes and two-thirds for 
*'presentaticm*') that the teacher sa^s he uses* That is not recorded anywhere^ 



C* Oral guesticms 



Supportive reactic^i: Correct responses were more often followed by a 
verbal ccamient than mte wrong answers* Correct responses solicited a 
cement such as ''ok^* •yesr'* •goodr* but often just a follow-up question to 
the same student* Wrong answers evoked a negative convent re the student's 
attention or preparation orr most frequently^ simply the same question put to 
another student* Questions from the teacher following oral reports were more 
interactive than general recitation* there was more verbal evaluation of the 
answers by the teacher* 

Cognitive levels: By and larger oral questicMis address recall (see 
IV*A*)* In the fcllow-up to the oral reports there is more use of higher 
order questions^ students on the panel asked to evaluate^ to comparer justify 
their opinions with arguments* 

Performance records: The teacher makes obvious use o£ the grade book 
during selected oral questioning sessicnsr recording each student's right or 
wrong response* A typical graded recitation session had SO possible points 
for those students selected for grading* After non-recorded questioning 
sessions the teacher often placed points in the grade book for students who 
had responded wll and noted those who were unable to respond correctly* 

Sampling: Hhen not explicitly selecting a sub-set of students for 
grtriling^ oral questioning tends to be conducted on the basis of 
volunteering* In history^ about four-fifths questions in such sessions were 
answered by volunteers* Some students shout out answers^ when a classmate is 
alow to respond* 



V* FEEDBAOC FfiOCEDURES 

A* Oral and nonverbal feedback (see also IV* B* and C*f above; some overlap) 

This teacher is very ooncerned with students* privacyr especially with 
regard to their assessments* Grade reports were scheduled to ccme out during 
the observation period andr in a session prior to their being mailed out to 
students'hcmes^ the teacher spent class time calling each student to his desk 
where he wrote down their grade and point standing on slips of paper* 
Several times he reiterated that *Ybur grades are. your grades and not to be 
shared with others** Questions about grades and progress are referred to 
private conference* 
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written feedback 

Tbe data bere are thin. Generally^ assignments and tests seen received 
only a letter grader although the teacher stated in interview that he tries 
to make a positive comment on each papei:. fioweverr it was clear that the 
most iufportant criterion for the teacher is that written feedback is positive 
in tone* Negative feedback^ he feelsr does nothing by discourage interest 
and effort (e-g.r see abover re the failure warning resports) . 



VI. DESCRIPTIOH OF TEflCHER AHD ASS£SSH£NT 
A- Teact^^r's background 

2. Two courses on evaluation ami measurement many years ^go in college and 
one in-service after arrival at this school. He regards them to have been of 
little value. 

B. Time expenditure 

Here I have construed "^teaching activities'* to exclude time spent in and 
out of class on non*ind true tionally-r elated activities^ such as reading 
aimounconentsr letting students fill out senior popularity questionnaires^ 
etc. — a total of quite a bit of time. 

1. One*on«one teaching is conferences with students. 

2. spends several hours every nigt^tr as well as his free periods working 
on assessment and instructional planning. The largest proportion of this 
time is spend correcting and writing assessments. AXso^ parent contact is an 
Important use of timel he makes two to three calls each night. 

This section addresses how the students' time is spentr at least their 
in^lass time (for which we have data). In these classes tine usage varies 
greatly by day and breaks down as follows: 

Instruction l0*-60% (of this totalr approximately 20% is 

lecture in economicsr 30% in history; 
70% is oral questioning) 

Assessment 17-65% (excluding test days^ but including 

giving out assignments^ correcting 
assigments and tests r answering 
questions about assignments^ tests and 
grad€sl in economics ^ includes student 
oral reports*) 

Other 4-30% (mostly roll taking^ announcements^ 

interruptions such as phone callsr but 
also reading and homework preparation 
time) 

* These oral reports are more assessment than instruction^ since the teacher 
goes over the material againr either ' lecture and oral questioning to the 
class or in expansions on questions ^^ut to the presenters. 
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C Teacher characteristics 

Attends to exceptional sttKJent: This teacher asks questions of the 
students most likely to know the answers and^ especially ^ to be willing to 
engage in discussion. He seeks to motivate students who are "bright^** but 
not working^ calling them into conference. He does also take pains to offer 
his "skills Enphasis** students the extra assignments and opportunities to 
write that the counsellors recommend for them. 

Expectations of professional self/ Structure needs/timeliness, 
flexibility/ attributions of student success 4 failures This is a highly 
structured classroom system-^a fixed grading policyf a set schedule for 
prcgressf pre*planned instrucctions and assessments. It is the same from 
class to class andf it possible to infers from year to yeai% Use of time is 
frequently referred to; desired testing outcomes are the object of 
instructicMfial questioning* The teacher believes that part of his job is to 
train juniors and, especiallyf seniors to be responsible for themselves: 
They are expected to look up missed assignments^ arrive on time for class 
with their bookSf pens and papers, to meet appointments made for 
conferences. The teacher is also more comfortable with a structured setting. 
Boweverf it often breaks down in classf the students drawing the teacher away 
from the planned instruction onto other topics and acting disruptively ; this 
is some sort of game in which they get him to fail to impose his structure on 
them. There appears to be no assessment punishment for this behavior — these 
are the **bright** students* 

Ttie teacher takes his charge very seriously. He would like to have a 
more standardi2edf department'-wide curriculum^ but as it now stands^ he is 
satisfied to completely cover the text material. He takes responsibility for 
student progress* **It^s up to the teacher to teach it^** he says^ and he 
spends many hours working with individual students and trying to engage their 
parents in their progress* 



VII. TEACHER'S PEBCEPTlOt© OP STUDENT CHJVRACT£RIST1CS 

Feedback needs: These are highly individual. He feels that all students 
need some positive feedback^ but some seek it all the time and others are 
mor€ independent* This need for confirmation he regards as an index of 
maturity. For examplep one sophomore who was enrolled in junior history kept 
asking from more comments on her wcrkf more questions to answer in clasSf 
additional assignments to do~8he is ^young^** he says. 

parental expectations* Generally, the lack of parental interest is a 
very serious concern for this teacher. He bleunes divorce and family problems 
for many of his students^ failure to take an interest in their schooiwork. A 
minority of pak^ents he describes as highly involved, but nuDSt are difficult 
to engager even though he requests conferences on the students^ grade reports 
and calls parents to discuss progress and how they might help. Parents who 
are interested usually have a fairly accurate picture of their children's 



potentials but he has some who think that their child is far brighter than is 
the case andr occasionallyr parents who underestimate their child. Overalls 
he wishes for higher parental expectations r since they motivate the children 
to do better. 

Teacher's definition of success; (1) Achievement; ''What counts is the 
final resultr what they've learned overall.** No single assessment indicates 
very much. He's succeeded if ''they learn that there's lots they don't 
know.** (2) performance; If there are lots of volunteers and a wide show of 
interests then the class is successful. (3) Thinking skills; Achievement 
must demonstrated^ that's most important^ and it's d^^^trated when a student 
''looks back on his own** and brings material from eaurlier in the year into 
current discussion^ ''as his own application.*' (4) Affect; When a student 
comes to cooperate in his/her own learning processr that^s successsr to ''do 
an assignment they've refused to do before^*' when they show ''increased 
motivation." 



VIII. OMGItIS OF POLICY 
Testing 

State; Minimum competency test is in preparation^ but not yet used. 
School; Final exam is required for American history by the school 
principal* percent of grade is set by him as maximum 30 percent; he reviews 
exaas drawn up by individual staff. Teacher's rule in final is maximum of 10 
percent. 

Reporting 

District; District requires grade reporting 4 times for 9-week periods. 
They do not require that a specific grade be tied to some specific percent. 
Use of the *'Coimnents Report*' ccmiputer multiple choice form is also optional^ 
thou^ recommended. Teacher always uses it. 



Class Size 

District; There are ''guidelines^*' but the union has not been able to get 
contractual limits as yet. 

Selection for Special Programs and Recognition 
Recognition; No information 

Distiljt/School; It is districtwide policy that counselors place students in 
accelerated/skills emphasis/advanced year classes^ At this schools this is 
strongly emphasized r teachers not even having recommendation power. The 
teacher tries to get students to request replacement themselves. 

Attendance 

District; policies are generally set by the district. 

School; Specific counting of latenesses^ opportunities to make up work are 
subject to school policy^ but the teacher basically does what he judges best 
on a case-by*^ase basis. 



Homework 
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Content to be Taught 

States Approves a list of acceptable texts to be selected fron by districts* 
District! Approves a list of acceptable texts to be selected from by schools* 
Department: Committee reccnnmends textsr siilection ratified by department 
vote* 

Discipline 

District/School: All discipline procedures are specified by the district and 
applied to building conditions by the school* However r the teacher takes 
some initiative personally^ requiring^ for example^ that a student cone in 
before or after school to do an assignments if the work has not been coming 
in or if he has doubts about whether the student is doing it him/herself* 
The teacher also uses classroom behavior and mrk completion as criteria for 
granting or denying such privileges as library passes* He also makes 
personal judgments about the worthiness of excusing students for other school 
activities^ based on how he values the activity and how often the student is 
absent from class* 



ERLC 4126e ^-^^ 



PROFILE OF SOCIAL STUDIES CASE #2 



I* ASSESSMSttT PURPOSES 



A* Diagnosing individual 
student needs 



3* Diagnosing group needs 



C* Assigning grades 



D* Grouping for instruction 
within class 



E* Identifying students for 
special services 



F* Controlling and 
motivating students 



G* Evaluating instruction 



H. Communicating achievement 
expectations 



Uninformed X Well informed 

irrelevant X_ Relevant 

Useless X_ Useful 

Hot used X Used frequently 

Uninformed X Well informed 

Irrelevant ^ Relevant 

Useless X_ Useful 

Hot used JC 2 tJMc* frequently 

Uninformed X Well informed 

Irrelevant _^ JL Relevant 

Useless X_ Useful 

Not used X_ Used frequently 

Uninformed x Well informed 

irre levan t X Re levant 

Useless X Useful 

Hot used X_ Used frequently 

Uninformed X Vtell informed 

irrelevant X Relevant 

Useless X_ Useful 

Not used X Used frequently 

Uninformed Well informed 

irrelevant JL Relevant 

Useless X_ Useful 

Not used X Used frequently 

Uninformed _X Well informed 

Irrelevant X_ Relevant 

Useless ^ _X Useful 

Not used X Used frequently 

uninformed X Well informed 

irrelevant X_ Reliant 

Useless X Useful 

Not used X Used frequently 



r o 
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I* Communicating affective 
expectations 



J* Providing test^taking 
experience 



Uninformed _X Well informed 

Irrelevant X Relevant 

Useless X Useful 

Not used X Used frequently 

Uninformed _X Well informoi 

Irrelevant X Relevant 

Useless _X Useful 

Hot used X Used frequently 



K* Relative importance 
of purposes 



60 



Given ^100 importance points'* to distribute 
across the purposes listed below# how would 
you distribute those points to reflect the 
relative inportance of the decisions listed? 



Diagnosing individual needs 
Diagnosing group needs 
*A8signing grades 
Grouping for instruction 
Identifying students for 

special services 
Controlling and 

motivating 
Evaluating instruction 
Ccnimunicating achievement 

expectations 
Ccmmunicating affective 

expectations 
Test taking experience 



10 



15 



100 points 



^Grades 58%; measure achievement 2%. 
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XI* ASSESSHBHT MCTHOOOLOCY 

A* Assessment of Achievement 

1* Teacher -developed paper and 
pencil tests and quizzes 



2* T^xt-^mbedded paper and 
pencil tests and quizzes 



3* Performance assessments 



4* Oral questioning strategies 



5* Standardized tests 



6* Group assessment 
methods 



Uninformed _3£ , Well informed 

Itsappropriate X_ Appropriate 

Us e le 8S X_ Us e f u 1 

Not used X_ Used frequently 

Uhinformed _X Well informed 

Inappropriate X Appropriate 

Useless X Useful 

Not used 5^ Used frequently 

Uninformed X Well informed 

Inappropriate Appropriate 

Useless X_ , Useful 

Wot used X Used frequently 

Uninformed X Well informed 

Inappropriate 3^ Appropriate 

Use le ss x_ Use f u 1 

Mot used X_ Used frequently 

Uhinfojmed X Well informed 

Inappropriate X Approjpriate 

Use less X_ Usef u 1 

Not used _X Used frequently 

Uhinformed X Well informed 

Inappropriate X_ Appropriate 

Use less X Use f u 1 

Wot used X Used frequently 



7* Opinions of other teachers 



Uhinformed 
Inappropriate 
Useless 
Not used 



X 



Well informed 

^ Appropriate 

Useful 

Used frequently 



8* Assessment of reasoning 
skills 



Uhinformed 
Inappropriate 
Useless 
Not used 



Well informed 

Appropriate 

Useful 

Used frequently 
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9» Regular assignments Uninformed X Well informed 

Inappropriate X_ Appropriate 

Use le ss X_ Use f u 1 

Not used X_ Used frequently 

10* Student peer rating Uninformed _X Well informed 

Inappropriate X Appropriate 

Useless J£ Useful 

Not used Used frequently 

11* Student self ratings Uninformed _X Well informed 

Inappropriate X Appropriate 

Useless J£ Useful 

Not used _X Used frequently 

12* Proportion of all assessments for all purposes that are of various t^pes 

Teacher-developed paper and 

pencil tests 35 
Text-embedded paper and 

pencil tests __1Q_^ 

Performance assessments 5 

Oral questions 15 

Standardi2ed tests Q 

OpinionB of other teachers Q 

Regular assignments 30 

Group assessments 5 

Student peer ratings 0_ 

Student self ratings 0 

100% 

13* Cognitive levels of questions posed int 
<ia«b« restatement of categories) 

Study and Oral Tests and 
Assignments* Discussion Questions Questions* * Quizzes *** 
Text-embedded TeachtDevl. 

Recall 74% 96% 100% 65-75% 100% 

Analysis 2% — 10-15% 

Comparison 6% 4% — 15-^25% 

Inference — — — — ^ — 

Evaluation 12% — 

*Both text-embedded and teacher-developed* 

**Higher figures reflect senior economics clastses* Most non-recall questions were 
put during follow-up to oral reports and addressed only to the students in the 
reporting group* 
***A11 teacher-developed* 



ERIC 



4126e 



268 



299 



14. Strategies for integrating 
a«.^0S3iient and 
instruction 



15. Dealing with cheating 



B. Assessment of Affect 

I. Observing individual 
students 



2. Observing group 
interactions 



3. Using questionnaires 



4. Using interviews {formal 
and informal) 



5. Opinions of other 
teachers 



6. Opinions of other 
students 



Uninformed ^ Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Not used X Used frequently 

Uninformed X Well informed 

I nappr opr i ate X_ Appr opr i a te 

Use le ss X_ Use f u 1 

Not used X_ used frequently 

Uninformed X Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Not used , X Used frequently 

Uninformed _X Well informed 

Inappropriate X_ Appropriate 

Useless X Useful 

Hot used _X Used frequently 

Uninformed _X Well informed 

Inappropriate X Appropriate 

tJseless ^J£ Useful 

Not used ^J£ Used frequently 

Uninformed X ttell informed 

Inappropriate X_ Appropriate 

Useless X_ Useful 

N6t used X_ frequently 

Uninformed JL Well informed 

Inappropriate X_ Appropriate 

Useless _X Useful 

Hot used _3£ , Used frequently 

IJhinformed _X Well informed 

Inappropriate J^. " Appropriate 

Useless ^J£ Useful 

Not used^ _X Used frequently 
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7* Opinions of parents 



84 Past student records 



Uninformed X Well informed 

I nappropr i ate X Appr opr i ate 

Useless X_ Useful 

Not used JL frequently 

Uninformed X Well informed 

I nappropr i ate Appr opr i at e 

Useless X_ Useful 

Not used X Used frequently 



9* Checklist of affective characteristics measured (considered): 



Seriousness of purpose 

Motivation and effort 

Attitude 

Learning style 

Interests 

Values 

Preferences 

Academic self^cmcept 

Locus of control 

Anxiety 

Maturity 

Social skills 

Study skills 

Other (specify 



Code I 

F « formal assessment conducted 
I " informal assessment conducted 
X « Hot measured 



10* Relative importance of affective assessment methods: 



Observing individual 

students 
Observing group 

interactions 
Using questionnaires 
Using interviews 

(fornal and informal) 
Opinions of other teachers 
Opinions of other students 
Opinions of parents 
Past student records 



40 



35 



10 



10 
'100% 



C# Assessment of Ability 

1* Meaning of ability for teacher 
Value of this factor 
for the teacher 



Important x Unimportant 
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Measurement of ability Measured formally 

Measured informally 
Not measured 



Ingredients considered in assessment of ability^ if measured: 

FACTOR(S) INCUJOED IN ASSESSMENT HEASCJHED HOW?-'-tione really 

measured 

1* Verbal ability Observation^ repartee 

2* General knowledge^ especially of current Class discussicm 

affairs**learning without reading for content 
3* Language barrier8~ncm*native speaking Class discussicm^ conferences 

students who manage are regarded as intelligent 
4. Parental involvenient»if they are not Conversations with parents 

assisting in motivation 6 the students does well^ 

it is from strong ability 
5^ Conf iraiation from parental examples of the Conversaticms with parents 

student^s ability, e*g*, stories of early 

reading, outside interests 

2. Check decisions influenced by results (i*e*, change with varying levels of 
ability)* 

X Instructional objectives 

, X , instructional strategies 

^ Grouping for instruction {within class) 

Methods for measuring achiev«iient 

X Grading standards 

X Students selected for special services 

X Other (spec^*y time and effort expended by teacher on the student ] 



D* Text Assessmenta 

Checklist of assessment components provided with text 



S 



Oral questions for class use 
Homework assignments 



n o info General assessment guidelines for teachers 

X Paper and pencil tests 

, , Performance assessments 

n o info Scoring guidelines 

n o info , Quality control guidelines 

, , Other {specify 



4126e 271 302 



ERIC 



III. CRITEKXA Pf^R SELECTING ASSESSMENT METHODS 

A. Results fit purpose Oninformed _X Well informed 

Unimportant ^ X_ Important 

Not used _^ Ji Osed frequently 

B. Method matches material Uninformed _X Well informed 

taught Unimportant X Important 

Not used X used frequently 

C. Ease of develoE«nent Uninformed X tt^ll informed 

Unimportant X_ Important 

Not used Z 35 Osed frequently 

D. Ease of scoring UninforroeS X Well informed 

Unimportant X_ Important 

Not used X_ Used frequently 

E. Origin of assessment Uninformed _X ttfell informed 

Unimportant , X_ Important 

Not used X_ Used frequently 

F. Time required to Uninformed JL , Well informed 

adninist^ Unimportant X_ Important 

Itot used X Used frequently 

G. Degree of objectivity Uninformed ^JC Well informed 

Unimportant X_ Important 

Not used frequently 

H. Applicability to Uninformed _X Well informed 

measuring thinking skills Unimportant X Iinportant 

Not used _X Used frequently 

I. Effective control of Uninformed X Well informed 

cheating Unimportant , X_ Important 

Not used X_ Used frequently 
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J* fi£lative importance ot criteria 



Results fit purpose 18 

Metliod matches material taught 10 

Ease of development 5 

Ease of scoring 10 

Origin of assessment 10 

Time required to administer IS 

Degree of objectivity 20 
Applicability to (Measuring 

thinking skills 2_ 

Effective control of cheating 10 

100% 
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IV. QUALIIY OF ASSESSHBNTS 

A. Percent of PaPer and pencil assessments { teacher-develop^ or text-embaddt \ 
having the following characteristics {need not total 100%}: 

% 

50 Clear description of assessment specifications 

90 Matches content of instruction 

90 Hatches cognitive levele of inetruction 

80 Hlnimizee tine required to gather needed Information 

SO Item format matcbee deeired outcome 

90 Items clearly written 

50 Items sanple domain 

70 Scoring proceduree planned 

W/A Scoring criteria written for eesaye 

, 80 Clear directions 

60 High quality reproduction 

50 Teet echeduled to minimize distractione 



B« Percent of performance aseesements having the following characterietice: 
% 

20 Clear description of trait to be measured with levele of 
proficiency articulated 
Hatches intended outcomes of inetruction 
100 Hinimizes time required to gather needed information 
80 Clear performance criteria 
80 Studente aware of criteria 

, 1 , 0 Thoughtful exercisee yield performance eamples 
10 Exercieee sanc>le performance donain 
Performance rating planned 
Besults match information neede 



C« Percent of oral gueetions having the following characterietics: 
% 

, 4 , 0 Sampling methode cover range of achievenent levels of students 
10 Strategies involve everyone 
30 Teacher waite for responee 
50 Student'e response given eupportive reaction 

Queetione match cognitive levele of instruction 
Written performance records maintained 
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V. £S£DBA(K PROCEDURES 

A* For oral and nonverbal feedback 

Percent of feedback delivered to students who are: 
% 

75 Strong (vs* weak) 

70 Correct (vs* incorrect) 

60 Hale (vs* female) 

Percent of feedback having the following characteristics: 
% 

, 20 , Delivered in class (vs* out of class) 

50 Oral (vs* nonverbal) 

20 Public (vs* private) 

80 Pair (vs» unfair) 

60 FDCUSed on achievasent (vs* affect) 

, , 70 Gennane (vs* irrelevant) 

60 Immediate (vs* delayed) 

60 Positive (vs. negative) 



B* For written feedback 

Percent of feedback delivered to students who are: 
% 

30 , Strong (vs* weak) 

30 Correct (vs* incorrect) 

50 Male (vs* female) 

Percent of feedback having the following characteristics: 
% 

10 cowmen t (vs* symbol) 

20 Positive (vs* negative) 

90 Fair (vs* unfair) 

70 <aermane (vs* irrelevant) 

, 90 Focused on achievement (vs* affect) 



Uses samples of performance Never ,JC Frequently 

as feedback 



Uses public achievement chart Never Frequently 

as feedback 
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VX. DESCRIPTION OF TEACHER AND ASSESSMENT 

A* Teacher's background 

It Teacher experience^ nuinber of yearst 



20+ Overall 

20+ At grade level 

12 In school 

5 With content 



2* Relative contributions of various sources to teaciier *s knowledge of assessment 
methodology 



l^acher preparation training 

Xnservice training 

Ideas and suggestions of colleagues 

Professional literature 

Teacher *s guide to textbooks 

Own experience in classroom 



_0_ 

0 



85 



100% 



B* Teacher *s eitpenditure of time 

1* Proportion of time spent in teaching activities 



% 

20 



Planning 



Ip ,, Teaching <one on one) 
40 Teaching <group) 
30 Assessing <see list below) 
Other (specify 



100% 



2* Proportion of time spent in assessmen t activities (paper and pencils performance 
assessments oralr assignments) 



Reviewing and selecting assessments 
Developing own assessments 
Administer ing 
Scoring and recording 
Providing feedback 
Evaluating quality 



20 



15 



35 



20 



100% 



C* Teacher characteristics 



Bole in the classroom 



Curriculum maker 
and presenter 



Servant of policy 
delivering 
required content 
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Expectations of Expects a 

professional self Expects little X great deal 

Structure needs Rigid _x Flexible 

View of high Correctness Degrees of 

quality performance demanded X quality eval. 

Stereotypic view of students None X_ Expressed often 

Attends to exceptional student Never X_ ^'^^equently 

Sense of performance norms Unclear X Very clear 

Orientation to experimentation No risks Risk taker 

Orientation to cheating No concern X Major concern 

Amount of cheating None A great deal 

Value o£ proiBptness; In^rtance 

of timely wrk co«pletion Unimportant Important 

Interpersonal environment of 

the classroom regarding assessment: 

Cooperative None x Frequent 

Competitive None x Frequent 

Attributions for reasons of 
student success/failure: 

20 Due to student 
eo Due to teacher 
100% 

Basis for grading students: 

20 Sense of ability 
SO Demonstrated achievement 
100% 

Interpretation of assessment: 



10 



90 
100% 



Korm-referenced 

Cr iter ion*ref erenced 
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VII# TEACHEH'S PERCEPTIONS OF STUDENT CHARACTERISTICS 

A* Ability to learn low X High 

Mo variation 3^ Great deal 

Variation ignored X Addressed 

B* Willingness to learn Low X High 

No variation 3L Great deal 

Variation ignored X Addressed 

C# Rate of achievwent low X High 

Decreasing X Increasing 

Ko variation 3L Great deal 

Variation ignored , X Addressed 

D* Maturity Irresponsible X Responsible 

No variation , X Great deal 

Variation ignored X Addressed 

E* Study skills Undeveloped X Developed 

Ko variation X_ Great deal 

Variation ignored X Addressed 

P# Social skills Undeveloped X Developed 

Mo variation 3C_ Great deal 

Variation ignored _X Addressed 

G* Willingness to perform Reticent X Willing 

Ko variation X_ Great deal 

Variation ignored X Addressed 

H# Feedback needs Wfeak X, Strong 

Ko variation X Great deal 

Variation ignored X Addressed 

I# Self-^assessment skills Undeveloped ^JC Developed 

No variation X Great deal 

Variation ignored X Addressed 
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J* Sense of fairness 



K* Reaction to testing 



Parental expectations 



Unclear X Clear 

No variation X Great deal 

Variation ignored _X Addressed 

Tranquil X Anxious 

No variation X Great deal 

Variation ignored X Addressed 

Unclear X Clear 

Low X High 

UniBiportant X_ Iinportant 

No variation Great deal 

Variation ignored X Addressed 
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CHAPTER 4* COHPAftXNG CLASSROOM ASSESSMENT EHVlROMMENTS 



In this chapter we explore similarities and differences across the eight 
profiles of classrooD asseasment environments* The exploration begins with 
comparisons of the tm profiles uithin each of the four subject matter areas* 
Then it turns to an analyisis of patterns across all eight environments^ 
focusing on each of the key ingredients in the profile: assessment purposes ^ 
assessment methods, criteria for selecting methods^ quality of assessments^ 
the teacher's relationship to assessment^ the teacher's perceptions of 
students and the role of policy in classroom assessment* 

Throughout this discussion, reference will be made to patterns seen in 
what teachers tend to do or not dor what they know^ think and feel about 
assessment and how they integrate assessment into instruction* Patterns 
discussed are those of the eight high school teachers studied only* 
Generalizations to any population of teachers beyond this small sanple may not 
be warranted* 

As a result^ some of the assessment phencmena reported and some of the 
conclusions drawn may represent speculations on our part as to the true nature 
of classroom assessment* These tentative conclusions are collected in this 
chapter in an attempt to begin to bring sane order to our understanding of the 
very complex world of classroom assessment* Homver, until our conclusions 
are verified by other researchers in other contexts^ we must remain cautious 
about their implications for teacher training. 



Comr::arieon Within Subjects 

Math * The two math cases are strikingly similar* Both are experienced 
teachers who are very clear about assessment purposes and methods* They 
measure student achiev€«ent (not ability) using math problem sets in which 
students must show all work for the purposes of diagnosing stud^t needs and 
assigning grades* The attainment of grades is the motivating force in both 
environments* 

The assessment of affective characteristics is also similar and very 
straight forward in both contexts* If students are doing the work on a daily 
basisf they are judged to be serious of purpose and are thought to be trying* 
This can influence grading decisions* 

Both teachers are adamant about using test problans that clearly reflect 
desired outcomes of their instruction* Each tends to focus on math problem 
solving processes and wants to test those processes* They feel that the 
text'^embedded tests do not provide this^ so they develop their own exercises* 
The result is paper and pencil assessments that are o:^ high quality in both 
cases* They learned to develop these tests through experience in the 
classroom* Formal training played no role in their assessments* 
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One area where the two differ is in their interactions with students using 
oraj. assessments during instruction. One teacher tends to ask rhetorical 
questions which he does not eitpect students to answer* He answers them 
hiiaself* The other teacher use8 these assessments to rocus the attention of 
inatt'antive students r turning misbehavior into ain apparently intense 
student/ tea Cher learning interaction. 

Both teasers spend a good deal of their instructional time (up to 1/3) 
involved in assessment*r elated activities. Since they have so many years of 
experience^ are fio clear on objective&r and have developed assessments 
frequently in the past, little assessment time is spent developing 
assessment. In both casesr a majority of assessment time is spent scoring^ 
recording and providing feedback. 

Finally, neither teacher is impacted to any great extent by policy* They 
use the required text and report grades when required. Beyond theses they are 
unaware of and inattentive to other existing assessment policies and 
guidelines. 

Science , The nature of the discipline of science and the study of biology 
may account for the similar curricular, instructional wd assessment practices 
used by both these teachers. Indeed, at the time of the observations both 
groups of General Biology were studying genetics. Both teachers conduct labsr 
put the weekly agendas on the boards give considerable hcmework and check it 
dailyr conduct assessment in a rather fixed manner r maintain a predetermined 
schedule and rate of material coverage r integrate assessment into instruction 
similarly^ use a notebook as a sunmative evaluation activity and put a great 
deal of responsibility for the learning upon the shoulders of the students. 
They rely primarily upon the assessment of performance by way of student 
products to determine understanding and to assign grades. Both teachers give 
considerable weight to student effort and participation as they affect the 
quality of a student's learning experience as well as the final evaluation* 
Even their weaknesses are similar. For instance, each could improve upon the 
recordkeeping of student participation and the oral questioning of students. 
They might also inform students more carefully about criteria and engage 
students more actively in the assessment process. 

While these two biology courses are quite similar in terms of assessments 
it is evident that students in these two settings are having quite different 
biology experiences* Students in the first case not only have a more rigorous 
academic courser but they are actively involved in the construction of their 
own learning. They are engaged in a team effort yet are desnonstrating 
independence of thought and are expected to be as creative and curious as they 
can possibly be. Even if they are getting C*s in the courser the teacher 
feels confident that they are achieving his goals of acquiring an attitude^ 
appreciation or love of science^ or^ at the very leasts of nature studies* 
Certainly the teacher makes a persuasive case for assessing without the use of 
paper end pencil tests. In the second caser the range of student experiences 
is quite narrow and, while students may be having a challenging experience in 
terms of work danandsr there is little opportunity for creativity, higher 
cognitive operations^ or independent thinking* 
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Language Arta. The two language arts teachers observed for this study 
enjoy both the subject matter they teach and their students* Although both of 
these teachers teach other subjects^ their main interest is teaching 
literature and their primary concern is to awaken their students to an 
appreciation and enjoyment of good literature* These teachers are rather 
similar in their views of the purposes of assessment* They use assessment 
primarily to diagnose group needs^ evaluate instruction and communicate 
achievement expectaticms* Unlike most of the other teachers observed in this 
studyr they do not place high emphasis on assigning grades* Both dislike the 
grading process and attanpt to diminish its Importance in students' eyes by 
using a point system and enphaslzing completion of assigned work (and thus 
engagement with the subject) more than the specific grade received* Both of 
these language arts teachers inform their classes that they would be happy to 
give *all A's* and that one just has to work hard to do well in their 
classes* The teachers differ somewhat on their use of assessment to diagnose 
individual student needs; the Case 1 teacher is more concerned with attctiding 
to individual students and makes greater use of assessment for that end* 

In terms of the methodology they use to assess achievement^ both teachers 
prefer to use tests ^ quizzes and study questicms they have developed 
themselves* They both make beavy^ daily use of oral questions^ for assessment 
and as an instructicvial tool* (Indeed^ in both of the language arts 
classrooms assessment and instruction appear to be well integrated and the 
teachers adjust their instruction according to the results from the various 
assessments they use*) Oral questioning lends itself well to the study of 
literature* However^ both teachers also use oral questicming in their other 
classes (composition and the study of mass media)* The Case 1 teacher makes 
greater use of oral questicming than does the other teacher* Although both 
teachers are skillful in the use of this technique to assess student and group 
knowledge and progress^ neither teacher routinely keeps written records of 
these daily assessments* (The Case 1 teacher has a column in her gradebook 
for oral participation^ but the record consists of a ^global* checkmark for 
the quarter or the lack of a checkmark*) Neither seems to be aware of the 
problems inherent in mental recordkeeping* 

Both teachers employ questions (oral and written) that tax a variety of 
cognitive levels* The Case 1 teacher states explicitly that her main purpose 
in teaching is to get the students thinking and synthesizing ideas and she 
looks to see how what they are learning is changing their thinking* This 
explicit purpose is reflected in the fact that she uses a better balance of 
higher order thinking skill questions in her assessments than does the Case 2 
teacher* Bothr however^ rely heavily on the use of recall questions* This 
appears to be a necessary management tool — to check that the students are 
actually reading the assignments* 

The use of performance assessments in these two classrooms is very 
limited* The nature of the subject matter (language arts) would allow much 
more extensive use of this type of assessment (demonstrating mastery by 
writing in genres such as essayr poetry^ satire^ short story^ for example^ or 
reading aloud)* 
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These teachers are very similar in the methodology they use to assess 
affective factors. Here againi the Case 1 teacher tends to give greater 
emphasis to observing individual students, vhere th<^ Case 2 teacher pays 
greater attention to group interactions. Regarding the assessraei^t of abilityi 
ttie teacher in Case 1 seems more concerned with the ability of her stujents 
than does the Case 2 teacher. On an Individual student levelf both believe 
every student has the ability to ach .«ve and perform adequately in their 
classes- The apparent Importance of ability in Case 1 emerges ;^en the 
teacher consider.? her students as a group. She constantly compares them with 
other students sh« has had in the past (and at another school) and feels she 
has had to lower her eacpectations and change her teaching to meet the level of 
her current students, fioweveri ability is inextricably entwined with 
achievement and willingness to perform. The lack of a clear understanding of 
the concept of ability and a clear separation of it frcm other more 
legitimately assessable constructs is problematic. It is difficult to 
determine the influence the teacher's view of ability truly has on her 
assessments . 

Itegardlng selection of assessment methods, the two teachers are quite 
similar. The Case 1 teacher is generally slightly better informed and pays 
more attention to the applicability of the assessment method to the 
measuranent of thinking skills* The quality of their assessments and the 
feedback procedures they use are generally quite similar. 

Where these two teachers differ considerably is in their background: The 
Case 1 teacher is a seasoned veteran, having taught for 20 years and having 
been the bead of the English Department during her career; the Case 2 teacher 
is in her fifth year of teaching. This difference in years of experience may 
explain the difference in the way the two teachers view thanselves 
professionally. The case 1 teacher clearly sres herself as the maker and 
presenter of curriculum, whereas the teacher in Case 2 considers her role more 
as the servant of policy delivering the required content. The Case 1 teacher 
has greater expectations of herself as a professional, she takes more risks as 
a teacher and pays more attention to individual students, even encouraging 
individuals to work at their own pace. She also fostera^ a collaborativef 
ratner then competitive environment in hor classrocm. The Case 2 teacher 
spends far more time teaching to the group and in fact actively discourages 
students from getting ahead of the group. 

Both feel teaching literature can be highly subjective and attempt to use 
objective methods in their assessments. The Case 2 teacher succeeds at this a 
little better than the teacher in Case If primarily because she relies more 
heavily on recallf true/falsef multiple choice and short answer questions in 
her tests and quizzes. The Case 1 teacher makes far greater use of essay 
questions, which tap into higher order thinking skillsf but which are more 
difficult to score objectively. In their essay scoring, both teachers use 
what appears to be "holistic" scoringt but their criteria are unstated- The 
Case 1 teacher is explicit in her technique of norm-referencing the scores by 
reading what she considers to be the top and bottom papers* first to establish 
how she will score a set of papers^ This apparent lack of clear criteria for 
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essay scoring is an area that needs further study* Neither teacher receives 
many conplaints about her scoring* This ntay be due in part to the fact that 
over time students have come to know what the teacher's expectations are* 

Another area of concern in these teachers' assessment practices is their 
inclusion of "effort" as part of the grades they give* The Case 1 teacher 
clearly considers effort in determining a student's grader particularly in 
cases where the student is at risk of failing but is willing to make an effort 
(despite a past history fraught with the lack of effort)* Both teachers 
consider effort (notivationr willingness to perform) in borderline cases as a 
way of determining the final grade* Neither seem to consider the possibility 
that level of effort is alrea«3y being reflected in each student's achievement 
and they might thus be assessing it twice* Also, in both cases the teachers 
are willing to give students the benefit of the doubt* Points^ grades and 
assessment comments are usually used in a positive way, to motivate and 
encourage students* 

As the above reflects, these two teachers have similar views of their 
students' characteristics , though the teacher in Case 1 usually has a slightly 
lower view of her students' skills and attitudes* Tkey differ radically only 
in their perceptiona of students' reactions to testing and in the level of 
parental expectations* These differences and the lower views held in Case 1 
may well reflect the differences in the populations the two schools serve* As 
noted in the case studty descriptions, parents in the Case 1 community tend to 
have low expectations for the continued education of their children, whereas 
the Case 2 community places a very high priority on education* The blase 
reactions to testing of students in Case 1 compared with the anxiety 
experienced by the Case 2 students is directly related to the family and 
community attitudes about the importance of education* The significance of 
the particular school/oonmunity influence on students' characteristics and 
teachers' perceptions of thw is also eugtjested by the fact that the second 
biology case study was conducted in the same school as Language Arts case 1 
and the ratings given the two teachers' perceptions of their students by 
independent researchers are almost identical* 

Social Studies * To a considerable extent, assessment in social studies 
appears to be shaped by the nature of the instructional content and by the 
teacher's understanding of the school's expectations for that subject* The 
two teachers observed for this study both teach U*S* history and 'economics, 
required subjects* However, the Case 1 teacher teaches an accelarated class, 
which differs greatly from Case 2's "regular** economics class and the latter 
teacher stated that his methods are very different for advanced groups* 
Therefore, the most valid comparisons can be made between the two teachers' 
approaches to American history* Case I's school offers U*S* history to 
sophomores while Case 2's classes are juniorsi it is not possible to isolate 
any effects of this difference in student maturity* 

In both schools the emphasis in U*S* history lies heavily on factual 
content of the subject* One teacher (#1) uses most of the class time for 
lecture; the other (#2) spends most of the instructional time in 
question-answer, expanding on the answers (correct or incorrect) to make 
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lecture"like reponses. The lecturer instructs by relyi^i? upon the students* 
ability to read and^assinfilate the te:ct material as the basic overview of the 
contents choosing selected points to expand upon in class that go far beyond 
the level of detail that the survey text offers. He balanced this technique 
with a chapter review assignment which directs the students to the text 
material they are expected to have learned. The teacher who relies on oral 
questioning generally follows the content outline of the text as he proceeds r 
thus providing the students with a daily model of the content for which they 
are held responsible. His questioning so closely follows the textr in factr 
that ntany students follow along in their books in order to anticipate answers 
to the upcoming oral questions. This teacher does not provide a review 
assignment before tests. 

Teacher t2, the oral questioner^ works to integrate assessment and 
instruction to a greater extent than the lecturer. He overtly records marks 
for reponses to questions in many of his class sessions and he uses the 
instructional time to develop the points that are to appear on the tests. Xn 
some casesr he reported^ areas which emerges in oral questioning as things the 
students have not prepared or do not understand will become test itenis. 
Remarks like^ ^Think about this for the test^** are not uncommon. The lecturer 
depends on the homework assignments ^ especially the review exercise to direct 
students' attention to the required content. Neither teacher makes 
significant efforts to revise instruction based on assessments although 
teacher #2 reported that he occasionally does recap based on poor homework 
results. 

Although presentation techniques vary^ eructations for what will be 
tested are similar and equally clearly^ though differently^ articulated. Both 
teachers test frequently^ relying on chapter tests and unit tests 
(encompassing 3-4 chapters) ^ a structure dictated by the textbook. Their 
testsr too, bear reseablence: They are tests of recalls using 
fill*in*the*blank and very short answer questions^ matching tasksr 
chronological ordering tasksr and short (3-S sentence) essays. If the two 
teachers were using the same textsr their students would probably perform 
similarly on one another's tests; even with different texts^ the same content 
was enpbasized for the historical periods observed. 

American history is a core high school subject andr in both teachers* 
viewf essential as preparation for responsible adult life in the U.S. They 
take their charge very seriously and appear to have in their minds some set of 
material that every high school graduate ought to have learned about his/her 
ne ion. It is that content that they seek to teach. Both feel that their 
textbooks contain this requisite content and that their job is to assure that 
the students learn it. Thus^ as American history teachers^ they have clear 
concepts of their charge for the year and that charge consisted largely of e 
body of specific information. It is not surprising^ then, that their tests 
are almost exclusively recall tasks. Just how it is that the teachers expect 
their students to make use of this historical overview to guide their lives as 
citizens remains unclear. Such skills are not taught in American history. 
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ThuB, both teachers' assessment methodologies are driven in part by 
accountability concerns* They see theittselves as accountable for the factual 
content of Anerican history* fioth also express the need to have a large 
nijmber of grades recorded that they themselves can regard as "objective" and 
tlmefore reliable measures of student achievement. Teacher #1 stated that he 
does not have the skills to w£it« valid questions that test higher order 
thinking skills^ although he tries (unsuccessfully) to integrate them into his 
testa* Teacher #2 depends on regular point grading to back up his grading 
decisions; he feels he needs to be able to demonstrate meticulous objective 
grading to protect himself from grade complaints. Both teachers lack 
understanding of methods for testing higher order thinking and for preparing 
valid performance assesfidients* 

Perhaps because of the heavy stress on recall and on "objective" 
questionsr the tyo teachers share concern about test security* Each devises 
his own tests* They also share lack of concern about security for their 
homework assignments^ relying on the text-embedded materials for most of 
these* Homework is a regular activity in both classes and an essential 
component of the overall assessment* 

Both social studies teachers reported that they conducted a sizing up 
exercise at the beginning of the term* In both cases this appears to have 
beenr at least In partr a free^ writing activity^ one of the only times 
students w«r« asked to write essays* It is Interesting that they relied on 
essay writing as an indication of overall readiness for the classr but do not 
employ essay writing as an assessment* This may relate to the concerns about 
accountability and objectivity noted above* 

Finally, both teachers articulated in interview and in class, strong 
beliefs that one of their tasks is to bring their students to take 
responsibility for themselves and their own educations* They see high school 
as a transition ground between childhood and adult responsibility and their 
professional charge as high school teachers to instill self-dependence and 
maturity in their students* They choose strikingly different strategies for 
this task* 

fiteacher $1 employs a distanced, professionalized relationship with the 
students, setting clear rules and requiring reasoned, documented excuses for 
exceptions to these rules* He brooks little personal interaction or 
misbehavior in his classes, modeling, it appears, a controlled, on-task 
self*presentation aa adult and responsible behavior* Students are directed to 
the school counselors for any non*content issues* 

fiteacher #2 att«npts to instill self -responsibility through interpers<»ial 
closeness, rather than distance* He takes responsibility for the students' 
learning onto himselfr spending a great deal of time working individually with 
sttiJents, trying to establish a network of student support with parents, and 
providing in-class time for joking, teacher -student and student-student 
interaction, and relating hie personal view of history* He reported that 
students need to know someone really cares about them and their achievement 
and uses his own concern as a motivator. While the rules in his classes are 
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equally clear and docunentedr this teacher is prepared to make exceptions if 
students try to show that they do care about their work and are trying to 
ishprove* He offers extra credit opportunities as a carrot to students vho are 
willing to put in extra effort* Bor teacher #2, affective variables such as 
effort become part of the overall assessments used as a strategy for promoting 
studwts* sense of control over and responsibility for their own educations* 



Comparlno Agaftaeaent Ptirpooes Across All Subjects 

Several patterns emerge in these eight studies regarding assessment 
purposes* The teachers use assessment most cooiRonly to assign grades and 
communicate achiev^ent expectations* Teachers are generally explicit in 
communicating grade expectations* As exanples, they use written grading 
policies^ sample problems and reviewr mitten assessment tasks and tests to 
give students a sense of what is important to know* 

The grading of academic achievement dominates almost all environments 
despite the fact that teachers dislike grading* Several teachers believe 
grading to be a bureaucratic requireoent that is counterproductive to their 
goals for teaching^ while others devise elaborate schemes to resolve issues of 
fairness and objectivity* Mlf however r keep records on student performance 
for the purpose of ccnpiling the final grade* There is considerable variation 
in how elaborate these records are and how much information is collected to 
determine the grade* 

Heasurenent for grading purposes is almost completely criterion-referencec^ 
in the sense of the use of percent cut-off scores* However^ objectives are 
often somewhat vague as are criteria for performance* Cut-off scores for 
grades vary greatly^ although seme are fixed by policy* Teachers vary in 
their consistency in applying cut-off scores* Affective and personality 
factorsr such as motivation, effort, or a teacher's sense of a student*s 
capabilities^ influence grades* Further^ teachers demonstrate considerable 
discretion in compiling information for the purpose of determining grades* 
Grades serve to send many different messages to students r only some of vhich 
relate to achievement and teachers often use their authority to ccmmunicate 
both affective and academic expectations to students through grades* Teachers 
are not ot^en challenged to explain a grade to either student, parent or 
administrators nor are teachers likely to check out the effects of grades upon 
students* 

The teachers studied appear not to be responsible for assessment for the 
purposes of grouping r selecting for special services and providing test-taking 
experiences* Role differentiation in the secondary school influences these 
assessment purposes* Students are often ''tracked*' or channeled by guidance 
counselors and once placed the teachers generally treat the entire class as a 
group* 

There is considerable variation across teachers in assessment for the 
purposes of diagnosing^ controlling and motivating, evaluating instruction and 
communicating affective expectations* Diagnosing is more often done during 
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instruction using infomiation generated through methods such as oral 
questions, review of homework and individual oonftrences* There is an 
affective component in nearly every assessment environment and it tends to 
focus on such attributes as attentiveness, effoit, participation or 
seriousness of purpose* This assessment feeds directly into decisions about 
gradesr as mentioned above* 



Aesessttent Methodology 

Assessment of Achievanent * Across classrcomsr teachers spend about a 
quarter of the available instructional time on assessment-related activities* 
This ranks in importance just behind whole group instruction* 

Methods used to measure achievement on a regular basis across subjects 
include dally written assignmentsr paper and pencil testa and oral questions 
as assessments* On the other hand, these teachers tend not to rely on 
standardized testsr group assessmentsr opinions of other teachers or student 
peer assessments* A great deal of variation was seen across teachers in 
teachers* reliance on performance assessments, student self-asaeasaentsr and 
text-embedded tests* *. 

Performance assessments (measures based on observation and judgment) are 
used to measure achievement in language artsr science and social studies, but 
not in math* Student self-assessment varies across teachers in that seme 
teachers leave it up to their students to let the teachers know if they are 
having difficulty* Aeliance on text-embedded assessments varies as a function 
of the availability of such assessments* Those who use texts that have 
accompanying assignmenta and testa use them to varying degrees^ while those 
who do not have them available obviously do not use them* Textbooks tend to 
serve more as a cource of daily assignmenta than of testa per se* These 
teachers tend to want to develop their own tests* 

Perhaps the most important problem noted in these classrooms is that 
teachers soaietimes use assessment methods without sufficient understanding of 
how to use them well* For example, it is not uncommon for teachers to espouse 
the Importance of teaching hioher order thinking skills, only to measure 
recall of facta and information, unaware that a discrepancy exists between the 
two* The result is invalid assessment* Further r teachers who rely on 
performance assessment methodology almost universally do so without explicit 
performance criteria or with vaguely defined criteria* When this occursr the 
danger of invalid and unreliable assessment is great* In other casesr 
teachers report using assessment based on group activities projecta 
resulting in judgmenta of individual student performance and seem unaware of 
the complexities of sorting out differential contributions of group members to 
overall project success* And finally^ oral questions during class, while used 
most often as instructional rather than assessment devices^ are conducted with 
virtually no written recordkeeping systans when used as individual student 
assessments* 
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On the positive side of achievement assessmentr teachers tend to develop 
their own paper and pencil tests to be sure the tests reflect the content they 

^ emphasize in class* Further^ the paper and pencil testa tend to be of fair 

technical quality (clear itoasr appropriate formatSr etcj* In additic^r they 
tend away from objective testa and toward performance and other assessments 
when outcomes warrant it* Finallyr they tend to focus their assessments on 
actual demonstrated classroom achievraent specifically defined^ rather than on 

^ vaguely defined concepts of student ability* 

Assessment of Affect , Affective assessments contribute greatly to the 
nature r role and quality of classroom assessment environments* These measures 
focus predominantly on the students* seriousness of purpose^ level of apparent 
effort and attitude (strong or weakr positive or negative feeling about the 
teacher and/or the subject)* These factors are measured by observing the rate 
^ and quality of student work and through interpersonal contact with the 

student* Resu Its influence student grades and teacher expectations of 
students* 

Within the affective dimension of classroom assessments two issues emerge 
as worthy of further consideration* The first issue revolves around a 

9 dangerous pattern noted in several classrooms in the linkage between affective 

assessment and the school reward systan* There appears to be a stereotypic 
personality type among high school students that teachers respond favorably 
to* These are the students who appear attentive and aggressive during class 
and who therefore receive higher grades than othersr not because they*ve 
learned more of the material but because they*ve learned to act like they are 

9 learning more* The implicit message communicated to these students seans to 

be "You don*t have to learn as much if you look like you*re trying*" Once 
they read the message ^ they may learn that they can manipulate classroom 
affective assessment to advantage* This is dangerous because it may be that 
whiter male students are more prepared culturally to fit this stereotype than 
white fonales or members of minority groups* This may lead to sex and ethnic 

# inequities in assessment and grading systafts* This is a complex issue that 
deserves further investigation* 

The second issue is similarly complex* The reward system of classroom 
assessment environments appears to operate on the assumption that a simple 
relationship exists between grades and student motivation* The assumed 

9 relationship holds that if students know a grade is linked to some particular 

behavior (e*^*r studying for a test)r then students will b^^have accordingly to 
obtain the reward* Butr in fact^ it appears that the actual behavior/reward 
relationship is far more complex than this* For good students^ those with a 
record of high achievwentr that simple relationship probably bolds-^they will 
work to get another rewarding A* Howeverr the complexity emerges when we 

9 consider those students tdiose experience has been one of failure-^not 

success* These are the students in the lower half of the distribution of 
achievement* Many teachers relentlessly cling to the premise that grades 
serve to motivate these students to learn also when for many that simply is 
not the case* For manyr grades are a punishment---^a constant public r^inder 
of failure-^not a reward* ftorking hard seems to have produced only failure in 

# the pastr so why bother* Once a student loses grades as a rewards since this 
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is the only motivating tool used by many teachers the ntotivation to continue 
to study is lost and frequently so is the student. If we ar$ to overcome this 
problem^ researchers and teachers alike need to develop a clearer 
understanding of the relationship between grades and affect (motivation and 
attitude) at all achievement levels**not just for high achievers. 

Criteria for Selecting Assessnient Method s 

Teachers across high school subject matter areas seem quite consistent in 
the factors they consider in devising or selecting assessments. Factors 
typically given careful consideration are time available for assessments the 
match between assessment and instructional objectives^ including applicability 
to assessment of thinking skills and appropriateness for a given purpose. 
Factors also considered include degree of objectivity and origin of the 
assessment. Factors considered less frequently include ease of development 
and scoring and the need to control cheating. 

However, it is inq^rtant to note in thi& context t^atf while these are the 
criteria often consideredr the extent to which they are varies greatly. 
For exaipler as noted above^ while teasers intend to measure higher order 
thinking skills^ often they are unsuccessful in doing so. Further^ irtiile many 
strive to remain objective^ vaque performance criteria often give rise to 
unreliable, subjective judgioents. In short, striving to apply the proper 
criteria does not ensure success. 

Quality of Assessatnts 

As has been suggested above^ the quality of the assessments observed 
varied. SoM assessments — typically daily assignments and tests of the paper 
and pencil variety— were generally sound across subjects. The major exception 
to this conclusion is the extent to which these assessments measured thinking 
skills. Examples of good quality performance assessment were noted, but most 
suffered from vaguely defined performance criteria and rating procedures. 
Oral questions were occasionally used as assessment devices^ often with no 
attempt to gather a representative sample of student responses and with no 
written recordkeeping. In fact, it was generally the case that the teachers 
observed had spent very little time reflecting on the nature or quality 
(validity, reliability^ and ccMnmunication value) of their assessments prior to 
participating in this stud^. 

Within this dimension of classroom assessment, some important and 
pervasive attitudes about assessment were noted. Firsts objective assessment 
formats tend to be accepted by teachers as dependable just because of the 
format and regardless of other qualities of the assessment. For this reason^ 
objective tests tend to be preferred by all. Essay tests and performance 
assessments, on the other hand^ tend to be seen by teachers as subjective and 
therefore less acceptable merely as a function of format regardless of other 
attributes. For this reason^ they feel they minimize use of these assessments. 
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students seem less sensitive to this distinction* Whether the test is 
objective or subjective, students do not question or challenge the teachers' 
performance criteria or assessment methods* Even in the face of subjective 
assessments and vagi^e criteria, students seem to unquestioning ly accept the 
teacher's assessment authority* While they may comment among themselves about 
the apparent lack of fairness of an assessment, they do not comment to 
teachers about this* 

Other quality control issues iiorthy of mention include the following: 

• As mentioned previously^ teachers tended to rely on mental 
recordkeeping to manage seme kinds of performance information^ such 
as responses to oral questions or behavioral indicators of affective 
traits such as attitude* These teachers ranain unaware of the 
dangers of bias inherent in such recordkeeping methods* 

• In addition, some assessments^ particularly daily assignments are 
often quite short (sometines two or three exercises)* The 
dependability of grades entered into the gradebook for such 
assignmnts must be questioned* 

• Further^ weighting schemes are popular in establishing grades at the 
end of grading periods* However r teachers using these schanes are 
often uninformed and uncertain about how to operationalixe their 
priorities in creating a lighted composite index of student 
performance* 

• Affective assessments are based on various kinds of measures* 
records of work ccmpletionr behavioral observations or personal 
interactions* To provide sound information^ these assessments must 
be valid and reliable* However^ quality control in this arena of 
assessment often receive little or no attention* Further r 

quest ionnaires*-a very efficient way to gather affective dataware 
virtually never used* 



Feedback Procedures 

The frequency and mode of feedback varies greatly from teacher to teacher^ 
butr generally^ feedback is fair^ germane to achievements and immediate* 
Feedback is used as a motivational toolr as well as a report to students on 
their achievement* 

Both in class and in conference^ strong students and students with cv^rect 
answers receive more oral and nonverbal feedback than those who are weak or 
give incorrect anstiers* Correct answers tend to elicit seme positive response 
from the teacher, e*g*, **ok,** **good,** but incorrect answers are most 
frequently simply passed over — the question is asked of someone else or the 
teacher supplies the answer* Strong students get greater feedback because 
they are more often corrects but also because they may also give more 
elaborated responses than do weak studentSf even when the latter offer correct 
answers* 
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Generally^ oral and nonverbal feedback is positive^ focused as it tends to 
be on stronger and more correct students. 

However^ seme teachers try to use oral feedback to admonish off^task 
studentSf using negative gestures and facial expressions as well Oral 
feedback to the class and to individuals is also used to att^pt to instill 
motivation- Discussion of the results of tests or assignments often has an 
evaluative component and teachers may report their overall assessment of group 
progress^ in addition to going over the correct answers. 

Written feedbacks by contrast with oral feedbacks tends to be more 
extensive for the weaker students. On assignmentSf wrong answers or overall 
poor papers are more likely to receive a coflanment in addition to the grade or 
point scoref than the papers of stronger^ more correct students^ for which 
teachers appear to feel a symbol suffices. Teachers are especially likely to 
comment when weak students' work is atypical— either better or worse than 
their usual effort. HOst comments are corrective^ rather than positive. Such 
comments are generally fair and focus directly on achievcuoent. Overalls 
written feedback is regular—most assignments are marked with at least a 
synrit>ol*<^nd stt^ents get feedbacK in a very timely fashion. 

Samples of performance and such public devices as public achievement 
displays are little used as feedback iMcfaanisins in these high school classes. 
Indeed, much of the feedback is private^ rather than public. Student papers 
are carefully handed back individually and some teachers ^hasise verbally 
that "your grades are your own^* so the marks should not be shared with 
others. Private conferences outside of class time or at the end or beginning 
of class periods are common. Choice of private over public feedback appears 
to reflect several teacher concernst the need to protect students' academic 
self*concepts; a desire to increase student self*responsibility ; teachers' 
general desire to deemphasize grading; arid teachers' need to protect their 
accountability by minimising student comparisons and appearance of inequity 
among grades. These factors may also be involved in teachers' tendency to 
provide oral feedback to strong and correct students^ as noted above. 

In grading^ teachers appear generally to be willing to give students the 
benefit of the doubt. If students have questions or complaints about grades^ 
these are carefully listened to and, if the arguments are persuasive^ teachers 
tend to be flexible. There is little evidence of use of grading for giving 
punitive feedback to students. 



Hie Teacher and Assessment 

Teacher's Background . All of the eight teachers observed during this 
study were seasoned^ experienced teachers. The number of years of teaching 
experience ranged from 5 to 33 years^ with seven of the eight teachers having 
taught for more than IS years. Half of them have spent their entire teaching 
careers at the same school. 
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All Of the teachers feel they have received very little useful training in 
assessment methodology* Their training to become teachers did not prepare 
them to address the assessment questions they face daily in the classrootn and 
contributed very little to their knowledge of assessment issues and 
techniques, similarly^ only two of the eight teachers have benefited at all 
from inservice training about assessment. Ideas and suggestions from 
colleagues and the teacher's guides of textbooks aie seldom used resources^ 
and almost no one consults the professional literature on assessment. Indeed, 
with regard to assessment and grading^ teachers work in extreme Isolation, 
generally without the benefit of colleagial collaboration. The Biology Case 2 
teaser's receptiveness to working with her new colleague is evidence of the 
positive effect such collaboration can have. 

Teachers' knowledge of assessment methodology^ thenr is based 
overwhelFtingly on their own classrooo experience. The methods they use to 
assess and evaluate their students are the result of years of determining what 
works for them in the classrocm and what they feel comfortable doing. Much 
can be learned from teachers' experiences and practical classroom applications 
of assessment techniques. However r as we have seen in the preceding eight 
case stu^ descriptions^ some teai^ers may not be aware of the pitfalls or 
implications of seme of their methods, and ^Amt appears to be sound assessment 
is not always done for the right reasons nor always consistently recorded. 

Teacher's Expenditure ot Time . Not surprisingly^ teachers spend a 
considerable amount of their time in assessment-related activities. On 
average; these teachers devote nearly a quarter of their time to assessment. 
The rest of their time is taken up in group instruction (nearly 40«), 
one-cn-cne instruction (15%), and planning (20%). Of the time spent on 
assessment activities^ the biggest block of time (about one*third) is devoted 
to scoring and recording results. The amount of time spent on this varies r of 
course, from teacher to teadier depending on the number ^^^id type of 
assessments conducted. One would expect more time to be spent on scoring and 
recording essay tests than on objective, machine*scored tests, for example. 
Thusr one might eicpect math or science teachers to spend less time on this 
activity than language arts or social studies teachers. In these case 
studiesr such claar patterns were not always apparent^ in part because seme 
science and math teachers spend most of their assessment time on scoring and 
recording and relatively little time on other assessment activities such as 
selecting assessments or developing their own. 

Teachers in these case studies spend about 20% of their assessment time 
developing their own assessments. Admiiiistering assessments and providing 
feedback consume approximately equal amounts of time (20% each). Little time 
is given to reviewing and selecting assessments (10%) and even less to 
evaluating the quality of the assessments (5%). 

Teacher Characteristics . These eight teachers differ widely in their 
views of themselves and their students and the classroom environments they 
have created. Half of the eight teachers v:ork very autoncMously, taking full 
responsibility for developing the curriculum and presenting it. Three of the 
eight, however, tend toward the opposite role of acting as a servant of policy 
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who delivers the re<iuired content* Host expect a 9reat deal o£ thoaselves as 
professionals* All have a relatively clear sense of performance norms f these 
are often unwritten^ however* Their views of what constitutes high quality 
perfonnance vary considerably^ ranging across the spectrum from denianding only 
one correct answer to accepting degrees of quality* As might be expected^ 
similar variation exists in these teachers* needs for structure and in their 
willingness to e^tperiment* 

These differences do not appear to be related to subject areas* As the 
case study descriptions illustrate^ one of the oath teachers is flexible and 
creative^ willing to experiment with different types of assessments^ whereas 
the other maintains a highly structured ^ rigid assessment environment* 
Similarly, the two biology teachers observed differ dramatically—one being 
highly innovative and flexible^ the other conducting a strict routine of 
structured assignments and tests* In social studies both teachers are rigid 
in the structure they have established for their classes^ but one was scfaewhat 
willing to experiment when students requested a different but reasonable 
approach* In language artsr the differences between the two teachers are not 
as clearly drawn as they are in the math and science cases* Both English 
teachers are relatively flexible, ready to adjust their instruction and even 
their assessment schedules as necessary for optimum learning; one of the 
teachers^ however ^ is far more flexible and willing to experiment and take 
risks than the other* 

Host of these teachers highly value prcmptness and timely completion of 
work* The only exception is the language Arts Case 1 teacher and even though 
this teacher is very flexible on this points she still makes note of late 
papers* The interpersonal dimensions of the assesiraient environments created 
by these eight teachers also vary considerably and do not follow any patterns 
related to subject area* In sone classrooms^ very little cooperation occurs 
or is encouraged^ in others it is frequent* The amount of ccopetition among 
students varies even more from classroom to classroom* The frequency of 
competition appears to be less than that of collaboration^ however^ 
Surprisingly enough^ teachers seem relatively unconcerned about cheating* 
This ftay be becau^ nearly all of then are interested in teaching the students 
to be responsible for their own learning* This orientation is reflected in 
the number of teachers who attribute the lion*s share of the responsibility 
for success or failure to the students themselves* Only one of the eight 
would take the bulk of that responsibility on himself* 

With the possible exception of the Social Studies Case 1 teacher who 
attempts to rwaain disengaged from his students^ these teachers all enjoy 
their students and would like them to do veil in their classes* Nearly all of 
these teachers operate with some preconceived or stereo^pic views of their 
students* Only the Biology case 1 teacher appeared to be free of stereotypes; 
but only the Math Case 2 teacher expressed them often* Host teachers tend to 
express these views when thinking of groups of students ^ but seem able and 
interested to deal .with individual students and their particular reeds when 
time permits* Seme teachers (such as the math teachers^ the Social Studies 
Case 2 and the language Arts Case 1 teachers) were far more willing to attend 
to individual students than were others* Stereotypic views can and do 
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influence instruction and assessment in some of these classrooms* The lowered 
expectations of the language Arts Case 1 teacher and the Biology Case 2 
teacher (both of whcm were teaching at the same school) may be based on past 
experience with what students in their school actually achieve or are willing 
to achiever but such eicpectations may not be fair to individual students in 
their classroc^is this year who struggle against that image or who would rise 
to meet higher escpectations if they were voiced* Similarly^ the Social 
Studies Case 2 teacher's assusq&tions that the boys who are acting out are 
''bright** may well have a detrimental effect on boys who don't act out or on 
girls in general because he clearly gives Kiore attention to those highly 
visible bcYB* 

Additional Comments on Teachers and Assessment * Begarding the grading 
process r these teachers grade almost entirely on the basis of dononstrated 
achievement* For the social studies and language arts teachers, their sense 
of the students' ability may enter into the assignment of grades* However^ 
they tend to articulate poorly what constitutes ability and how to measure it 
separately from achievauent or affective characteristics r such as motivation 
or seriousness of purpose* Students' level of effort is considered by all 
teachersr particularly in borderline cases* The problems implicit in 
including ability or effort in the grading process do not sean to be clear to 
these educators* 

Nearly all assessment conducted in these classrooms is considered to be 
criterion-referenced in the sense that a certain level of performance is 
expected of all* flowever^ the social studies and language arts teachers^ 
unlike math and science^ use both norm and criterion referencing* Even when 
teachers say they are basing everything on a percentage of the total points 
possible^ they often have distributed the points based on the group norm* The 
clearest example of this is found in Language Arts Case Ir where the teacher 
reads what she considers th.e top and bottcw students' papers before reading 
the entire set and determining how to distribute the points* There is a great 
need for a clearer understanding of the grading process^ what is considered 
and how it is considered* Much could be done to help teachers analyze their 
own practices and assumptions* 

Another concern is that teachers tend to **objectify** their assessments; 
that isr most are aware of the need to be objective and the perils of 
subjectivity and they therefore try to make their assessments as objective as 
possible* However r more careful analysis is often needed to determine the 
validity of some of the assessment methods and criteria* For example r 
teachers whose main purpose is to teach thinking skills may use questions 
which assess primarily lower level skills (particularly recall) without any 
awareness that their questions are not assessing what they purport to teach* 

Uhfortunatelyr in most of these case studies^ instruction and assessment 
seem to be separate activities for the teachers* Integration of the two is 
done haphazardly and rarely to full advantage* Host teachers either do not 
take the time or do not ki»w how to make good use of assessment in presenting 
instruction^ in evaluating it, and in making it more effective and 
meaningful* The language arts teachers observed here tend to make the best 
use of assessment as an instructional tool and as a way to evaluate 
instruction and diagnose student needs* 
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Teachers* Percepti<ma of Student Characteristics 

As the case study profiles illustrate^ these eight teachers have widely 
varying perceptions of their students* characteristics* Although all feel 
their students have from moderate to high ability to leam^ they rate their 
willingness to learn^ their willingness to perform^ and their rate of 
achievenent a little lower* Half of the teachers see their students as 
relatively irresponsible! only the Biology Case 1 teacher considers his 
students to be responsible* In generals teachers think their students* study 
skills are not as well developed as their social skills^ and their 
self assessment skills are the least developed of these three 
characteristics* Their feedback needs vary across the spectrum f rm 
relatively weak to a strong need for feedback* Their sense of fairness and 
their reactions to testing also vary considerably^ 

Bach tut jher is faced with seme (and in many cases a great deal of) 
variation in these characteristics among his/her particular students* Rate of 
achievement is the characteristic in which greatest variation is noted^ 
However r teachers* responses to these variations range across the spectrum 
from ignoring them totally (even though they admit they exist) to addressing 
them* ^Teachers of a particular subject do not necessarily share the same 
perceptions of their students^ nor do they respond in similar ways to the 
variations among students^ The Hath Case 1 teacher^ for exanpler recogni2es 
great variation in student traits and therefore dedicates 10<-20 minutes of 
each class period to individual students* The Case 2 Hath teacher also 
perceives differences among his students and attends to some of those 
differences in character is tics ^ but bis cynicism about a few poor students may 
be coloring his feedback to all of his students* The two social studies 
teachers are aware of variations in their students^ and both tend to ignore 
such variations* However^ they vary consideraoly in the ways tbey conduct 
their classrooms~the Case 1 teacher refusing to acknowledge variations and 
individual characteristics so that his students will rise above those 
differences and take on the responsibility of learning^ and the Case 2 teacher 
so aware of one particular group of students (the boys who act out) that be 
ignores most other variations among bis students* The two language arts 
teachers tend to be most involved in addressing the v«u:iations they perceive 
among their students* 

These teachers have been able to learn surprisingly little about parental 
expectations^ although they think parental expectations are relatively 
important^ Tbey tend to think parents do not expect much of their children^ 
The extent of parental expectations and parental involvement is related in 
some teachers* minds to the nature of the community served by the schools The 
two language arts teachers^ for example^ work in very different caamunities* 
nie Case 1 teacher *s school serves a working class neighborhood in which 
education has not been highly valued as one of the major paths to a successful 
lifei this teacher *s previous e^qperience with parents at a school which served 
a more upwardly mobile cciBBunity led her to make constant comparisons and 
judgments about the effects of the lack of parental involvanent and 
encouragement at her present school* The Case 2 teacher works in a school 
which serves a suburban^rural community in which moct parents have high 
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expectations for their children's educations* Host teachers deal with parents 
when the need arises (as in cases where the student is at risk of failing the 
class) f but have little tine to do more* Their emphasis on teaching students 
to be responsible for their own educational experience leads these teachers to 
be less involved with parents* The only exception to this is the Social 
Studies Case 2 teacher \ho makes a special effort to call three Parents a 
night* (This teacher is also the teacher who takes most of the responsibility 
for students* success or failure on himself*) 

As noted in the discussion above about teachers' stereotypic views of 
studentSf teaclters have well-established (and sometimes erroneous) views of 
changes in student characteristics over the years* These perceptions have a 
powerful influence on teachers' expectations for their current studenta* 
Teachers may be unaware of the dangers of judging individual students on the 
basis of apparent 'trends*'^ 



Policy and Assessment 

Policy is an area about which teachers appear to be relatively uninformed 
and about which they concern themselves very little* Even where district or 
school assessment and assessment^r elated policies exists teachers are largely 
unaware of them. Mien they are aware of certain policieSi they appear to have 
the autonomy to ignore them by and large* l^achers very broadly control the 
conduct of their own classroonsf including assessment aspects* 

Grading methodoXogyi frequency of grading, homework assignments, types of 
questions, etCw are largely ungoveired by policyi regardless of whether 
school or district policy in fact exist''* The only clear requiraaents appear 
to be the quarterly or nine*week r«%v £^./.ng period and the requirement to 
provide letter grades* These the teachers fulfill* albeit in many cases 
reluctantly* Some teachers feel responsible to have demonstrated records to 
back up their grade report decisions! providing extensive markings; others 
feel no such needi although school policies dentand denonstrable bases for 
grades in class records* 

Teachers in at least seme departments appear to feel directly inipacted in 
their assessment practices by consensual practices and agreements developed 
with their colleagues* In some cases ^hese are in direct contradiction to 
established school or district policy* Departmental level decision^a^cing 
with regard to textbooks governs much of the teachers' assessment practicesi 
since many ^loy text^^mbedded assignments and tests* Despite these 
assessment inplicationa, quality of assessments in the text are rarely a 
consideration in text adoption* Those involved in the selection process do 
not possess the skills and knowledge to evaluate tests and assignments* In 
only a few of the observed cases did a teacher depart frca use of the 
departmentally*selected text; these were generally in accelerated classesi 
where teacher decision-making is even more strongly emphasized. 

In certain areas, teachers are constrained by the roles of guidance 
counselors* These counselors have broad a mandate to assign placement to 
advanced or remedial tracki: and to meet with parents and students* In 
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generalr teachers tend to accept counselors' placement decisions and work with 
the students as best they can. They do this despite the fact that they appear 
0 to know little about counselors' knowledge and skills for determining 

placeuients across academic su^jects^ criteria counselors use in making such 
plaoementSf or the sources and quality of information that they use. However r 
in at least seme schoolsr teachers can influence or override placements and 
can intervene directly with students and their parents around academic 
progress and disciplinary matters. For example r one teacher eschews the 

# school's mandated warning of failing grade forms^ choosing instead to make 
personal phone calls to the parents. Thisr he arguesr is more congruent with 
his approach of trying to create motivation by developing confidence and 
positive attitudes to school. Teachers vary in their interest in directly 
dealing with parents^ ccmplaints^ and student non-class issuesr but they 
appear to have great leeway to do so, if they choose, regardless of building 

^ or distiict procedure as outlined in policy. 

The role of principals as instructional leaders and policy makers in the 
assessment arena remains unknown. In only one case was it clear that a 
teacher's assessment policy had been affected by his principal's desires**the 
Social Studies Case 2 teacher included what he regarded as higher order 

# thinking questions in bis yearly final at bis principal's request. Further 
research should address how principals supervise assessment; what knowledge 
they possess about good assessment; their expectations; the extent of their 
supervision of their teachers' classroom assessment practices; and bow and how 
uniformly such supervision is cmducted. 

• 

Salary and Iteplicaticna 

He began this report with the premise that there is much that remi»ins 
unknown and unclear about the complex world of classroom assessment. Perhaps 
the primary outccme of this study is that we have developed at least the 
O rudiments of a framework within which to understand the cooplexity. Using 

that frameworks we have profiled eight high school classroom assessment 
environme'^ts. While we realize that eight case studies do not provide a basis 
for drawing firm conclusions about either the state of classrocm assessment in 
our schools or needed action programs r we feel that seme issues emerge from 
our analysis that deserve further attention. We present these below in the 

# form of iiqpli cat ions for training in asses ment, assessment policy and further 
research on classroom assessment. While we feel confident that subsequent 
studies will corroborate these conclusions^ we encourage and support the 
further research and development needed to verify or revise then. 

Implications for Training in Assessment . Given the nature and limited 

# extent of teachers* formal training in assessment methodology r consideration 
of how they spend their assessment time can provide seme insights into teacher 
training needs. Perhaps of greatest concern is the fact that teachers sper*^ 
so little time evaluating the quality of their assessments. Teachers with 
full class loads and large classes have many constraints on their time. 
Eowavers knowing if what they are doing is valid^ reliable^ fair and useful 

# should be of utmost importance. Teachers have not been trained in ways to do 
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this. Many of the assessment inconsistencies observed in these caBe studies 
could be avoided or r^edied i£ teachers received inservice training in how to 
evaluate the quality of assessments. This would improve the review and 
selection process as well as help teachers as they develop their own 
assessments* As we have seen, teachers often write their own testSr (juizzes 
and study questions^ with little or no formal training on which to base this 
asaesement development. Even though teachers spend a large part of their time 
in assessment activities and have come to rely on their experience # most 
escpress concern and lack of confidence that they are conducting assessments 
properly. They would welcome further training opportunities. 

More specifically^ tf^acber preservice and inservice should focus upon 
topics that range far beyond developing traditional paper and pencil tests. 
Other iiQportant topics include: 

• How to evaluate the quality o f an assessment in terms of its match to 
intended instructional outcom ' a nd the dependability of results . 
Training should focus on the teacher^s own assessments as well as 
assessments acocxdpanying text materials. 

• How to select a type of agaessment that will fit a particular purpose 
and do so efficiently (i*e.r how to integrate assessment with 
instruction). Training should illustrate the full range of viable 
assessment options available for classroom use (assignments^ paper 
and pencil tests and quizzes^ performance ass'^ssmentsr published 
testSf self evaluations peer evaluation and assessment records) and 
show how they relate to various classroom decisions. 

• How to deal effectively with the subjective elements in classroom 
assessment . Training should address the inevitability of subjective 
assessment and show how it can be done with maximum quality « 
efficiency and fairness. 

« How to establish performance criteria as the basis for classroom 

assessment * Outcomes that are measurable in a valid and reliable way 
are those that the teacher can define and for which the teacher can 
articulate an underlying continuumf from low to high performance. 
Training should provide teachers with the tools to do this. 

• Wlien affective assessment has a role to Play in classrooms and how to 
conduct affective assessments that are of high quality . Teachers 
need to openly explore and understand the nature of student effective 
traits and they must learn the prc^lems and pitfalls o£ assessing 
these traits. Then and only then will they be in a position to 
integrate them into classroom assessment. 
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• How to develop and implement sound grading and other feedback 
practices ^ Training should focus on two key aspects of this; 

(1) the definition o^ sound grading practices (ite^r via sound 
assessment, appropriate cut^ffsr appropriate weighting, etc J, and 

(2) the effects of grades as a motivator across all levels of 
tichiev^nent* 

• How to understand and avoid stereotypic thinking about students and 
achiev^nent or affect . Teachers need to know the dangers of 
typecasting students both in terms of its impact on expected and 
actual student performance* 

In additim to these implications for teacher training^ attention must 
also be given to assesantnt training for principals* If they are to be 
instructional leaders and if assessment occupies a quarter of available 
instructional tine, then principals need to be able to provide leadership in 
assessment* Since most are former teachersr we know how little assessment 
training they started with*^ Since most principal certification programs 
require little or no further training in assessment, we can conclude how much 
leadership most principals are able to provide in this arena* If we are to 
attain the goal of effective assessm^^nt environments in all classrocmsr this 
must change* 

Finally^ we might consider the revolutionary concept of training students 
in assessment* Given knowledge of the rudiments of sound assessments they 
would be 3 position to act in their own best inter^str pointing out vaguer 
unfair or inappropriate assessment and classroom decision-making* 

Implications for Assessment: Policy * For those concerned with setting 
dir'^rict and school policy^ we might pose the following questions regarding 
classroom assessment policy; 

• Given the relative in^rtance of classroom assessment compared to 
district-wide assessment in the growth and development of students^ 
are district financial resources for assessment being distributed 
appropriately between the two? 

• Given the relative importance of as sessment^r elated activities to 
other instructional activities in the classroom, are sufficient 
resources being spent to develop staff skills in assessment? 

• Given the importance of assessment to the quality of instruction^ are 
text-embedded tests being syjstematically evaluated in the process of 
considering various textbooks for adoptitm? Should they be 
evaluated? If so, by whom? 

• What role should policy play in determining the nature, role and 
quality of classroom assessment? And how should teachers be made 
aware of that role and the policies to be implemented? 

• How are teachers currently supervised with regard to classroom 
assessment, given most principals' lack of training in this arena? 
Bow should they be supervised? 
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The danger exists that most of che key players in the policy making arena 
are equally uninformed regarding classroom assessment issues* Teachers £^e 
largely untrained and are left to their own devices when it comes to clf^sroom 
assessment* Principals are former teachers* Superintendents and assistant 
superintendents are former principals* And members of boards of education are 
lay people untrained in education^ not to mention assessment* Nowhere in tbe 
professional development of any of these policy makers is th^re a place where 
issues of assessment and evaluation are addressed in a forthright and thorough 
manner* Thus, the danger exists that policy may address these issues in a 
naiver or worse yet, technically unsound manner* Therefore, the policy 
context surrounding assessment in general and classroom assessment in 
particular deserves careful attention soon* 

Itoplications for Research on Classroom Assessment* Through the final 
chapter of this reports we have puzzled at tines over issues that ronain 
unresolved in our program of research* As we continue our research in this 
important arena, we will be guided by unanswered questions such as these* We 
encourage other researchers to be similarly guided t 

• Can the nature r role and quality of classroom assessment be Improved 
via systematic and relevant teacher, principal and policy maker 
training? 

• How extensive is the mismatch between instruction and assessment of 
higher order thinking skills? 

• How universal and intense is teachers* dislike of grades and 
grading? What are students* and parents* values in this regard? 
What liable alternatives existV 

• What is the effect of grades on student motivation and achievenent at 
all levels of achievement? 

• What is the effect of different kinds of assessment on student 
preparation for and performance on those assessments? 

• What is the nature and quality of assessment training provided to 
guidance counselors — those given responsibility for placing students 
in high tiichool classes? 



A Firal Comment * We initiated our research with the purpose of gaining an 
indepth understanding of classrocm assessment* Wte felt that a major reason 
for the neglect of classrocm assessment by the m^easurement research community 
is its extreme complexity* We do not seek to reduce that complexity* Rather 
we seek only to understand it and help 'ceachers function effectively within 
such a complex and demanding environment* We remain unsure as to our 
success* We are concerned about the reliability of our profiles* Our 
observations are limited to high schools (and junior ulghs in a previous 
study)* And we have watched and interacted with only a few teachers. But 
even with these limitations, the great depth we have been able to achieve 
suggests that action is needed* Only the scope of that need remains uncertain. 
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